2024-09-13T17:52:25.689 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T17:52:25.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T17:52:25.819 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951 branch: wip-rishabh-testing-20240910.100730-reef description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7903951' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - overall HEALTH_ - \(MON_DOWN\) sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T17:52:25.819 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T17:52:25.820 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T17:52:25.821 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T17:52:25.822 INFO:teuthology.task.internal:Checking packages... 2024-09-13T17:52:25.843 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T17:52:25.843 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T17:52:25.843 INFO:teuthology.packaging:ref: None 2024-09-13T17:52:25.843 INFO:teuthology.packaging:tag: None 2024-09-13T17:52:25.844 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:52:25.844 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T17:52:25.844 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T17:52:25.997 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860-g6c6b083f-1focal 2024-09-13T17:52:25.998 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T17:52:26.004 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T17:52:26.004 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T17:52:26.017 INFO:teuthology.task.internal:Saving configuration 2024-09-13T17:52:26.034 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T17:52:26.041 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T17:52:26.074 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:46:00.929862', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T17:52:26.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 17:46:00.928081', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-09-13T17:52:26.104 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T17:52:26.110 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-09-13T17:52:26.111 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-09-13T17:52:26.111 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T17:52:26.187 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc56e3b4a60>, signals=[15]) 2024-09-13T17:52:26.187 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T17:52:26.193 INFO:teuthology.task.internal:Opening connections... 2024-09-13T17:52:26.193 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T17:52:26.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:52:26.302 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T17:52:26.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:52:26.401 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T17:52:26.408 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-09-13T17:52:26.415 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-09-13T17:52:26.415 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-09-13T17:52:26.464 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Ubuntu" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:ID=ubuntu 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE=debian 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="20.04" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_CODENAME=focal 2024-09-13T17:52:26.465 INFO:teuthology.orchestra.run.smithi088.stdout:UBUNTU_CODENAME=focal 2024-09-13T17:52:26.466 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-09-13T17:52:26.499 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-09-13T17:52:26.505 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-09-13T17:52:26.506 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-09-13T17:52:26.512 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="Ubuntu" 2024-09-13T17:52:26.512 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-09-13T17:52:26.512 INFO:teuthology.orchestra.run.smithi094.stdout:ID=ubuntu 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE=debian 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="20.04" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_CODENAME=focal 2024-09-13T17:52:26.513 INFO:teuthology.orchestra.run.smithi094.stdout:UBUNTU_CODENAME=focal 2024-09-13T17:52:26.513 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-09-13T17:52:26.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T17:52:26.550 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T17:52:26.555 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T17:52:26.555 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:52:26.558 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-09-13T17:52:26.563 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T17:52:26.568 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T17:52:26.568 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:52:26.570 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-09-13T17:52:26.590 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T17:52:26.657 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T17:52:26.672 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T17:52:26.672 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T17:52:26.673 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:52:26.673 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T17:52:26.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:52:26.679 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-13T17:52:26.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T17:52:26.680 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-13T17:52:26.686 INFO:teuthology.orchestra.run.smithi088.stdout:5.4.0-124-generic 2024-09-13T17:52:26.686 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.4.0-124-generic 2024-09-13T17:52:26.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-09-13T17:52:26.729 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-124-generic 2024-09-13T17:52:26.729 INFO:teuthology.task.kernel:Running kernel on smithi094: 5.4.0-124-generic 2024-09-13T17:52:26.730 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-09-13T17:52:26.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-09-13T17:52:26.841 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-13T17:52:26.947 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T17:52:27.001 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:52:27.001 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T17:52:27.002 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [128 kB] 2024-09-13T17:52:27.064 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:52:27.074 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T17:52:27.145 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [128 kB] 2024-09-13T17:52:27.244 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T17:52:27.338 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T17:52:27.380 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T17:52:27.383 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T17:52:27.383 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T17:52:27.384 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T17:52:27.384 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [3,195 kB] 2024-09-13T17:52:27.404 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T17:52:27.407 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T17:52:27.407 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T17:52:27.411 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T17:52:27.417 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T17:52:27.419 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T17:52:27.419 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T17:52:27.419 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T17:52:27.420 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T17:52:27.433 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T17:52:27.499 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [128 kB] 2024-09-13T17:52:27.542 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T17:52:27.544 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [812 kB] 2024-09-13T17:52:27.557 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [472 kB] 2024-09-13T17:52:27.560 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [14.3 kB] 2024-09-13T17:52:27.561 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [38.3 kB] 2024-09-13T17:52:27.561 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [3,117 kB] 2024-09-13T17:52:27.584 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [436 kB] 2024-09-13T17:52:27.588 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T17:52:27.588 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [1,011 kB] 2024-09-13T17:52:27.596 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [681 kB] 2024-09-13T17:52:27.600 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [213 kB] 2024-09-13T17:52:27.602 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [21.2 kB] 2024-09-13T17:52:27.602 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.8 kB] 2024-09-13T17:52:27.602 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2024-09-13T17:52:27.607 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,968 B] 2024-09-13T17:52:27.609 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2024-09-13T17:52:27.610 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T17:52:27.639 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,563 kB] 2024-09-13T17:52:27.654 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T17:52:27.660 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T17:52:27.661 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T17:52:27.697 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T17:52:27.697 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T17:52:27.701 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T17:52:27.701 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T17:52:27.709 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T17:52:27.714 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T17:52:27.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T17:52:27.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T17:52:27.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T17:52:27.717 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T17:52:27.731 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T17:52:27.731 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T17:52:27.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T17:52:27.732 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T17:52:27.748 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T17:52:27.748 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T17:52:27.749 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T17:52:28.038 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [1,030 kB] 2024-09-13T17:52:28.066 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [550 kB] 2024-09-13T17:52:28.079 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.7 kB] 2024-09-13T17:52:28.080 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [39.6 kB] 2024-09-13T17:52:28.081 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [3,236 kB] 2024-09-13T17:52:28.171 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [453 kB] 2024-09-13T17:52:28.189 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [548 B] 2024-09-13T17:52:28.189 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,230 kB] 2024-09-13T17:52:28.227 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [807 kB] 2024-09-13T17:52:28.247 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [295 kB] 2024-09-13T17:52:28.253 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [28.0 kB] 2024-09-13T17:52:28.254 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,440 B] 2024-09-13T17:52:28.254 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [27.1 kB] 2024-09-13T17:52:28.258 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,936 B] 2024-09-13T17:52:28.286 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [616 B] 2024-09-13T17:52:28.287 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-09-13T17:52:28.287 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-09-13T17:52:28.368 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-09-13T17:52:28.369 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-09-13T17:52:28.369 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-09-13T17:52:28.370 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-09-13T17:52:31.739 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 21.8 MB in 3s (7,374 kB/s) 2024-09-13T17:52:31.885 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 21.8 MB in 3s (7,118 kB/s) 2024-09-13T17:52:33.305 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T17:52:33.333 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:52:33.410 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T17:52:33.437 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T17:52:33.464 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:52:33.535 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T17:52:33.625 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-09-13T17:52:33.625 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-09-13T17:52:33.729 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-13T17:52:33.730 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-13T17:52:33.823 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-09-13T17:52:33.823 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T17:52:33.823 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T17:52:33.824 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T17:52:33.825 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-09-13T17:52:33.825 INFO:teuthology.orchestra.run.smithi088.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T17:52:33.825 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-09-13T17:52:33.825 INFO:teuthology.orchestra.run.smithi088.stdout: thermald 2024-09-13T17:52:33.882 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-09-13T17:52:33.882 INFO:teuthology.orchestra.run.smithi088.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T17:52:33.883 INFO:teuthology.orchestra.run.smithi088.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T17:52:33.883 INFO:teuthology.orchestra.run.smithi088.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T17:52:33.884 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-09-13T17:52:33.885 INFO:teuthology.orchestra.run.smithi088.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T17:52:33.942 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-13T17:52:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T17:52:33.942 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-generic linux-image-5.4.0-195-generic 2024-09-13T17:52:33.943 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-5.4.0-195-generic linux-modules-extra-5.4.0-195-generic 2024-09-13T17:52:33.944 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-13T17:52:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-09-13T17:52:33.944 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-09-13T17:52:33.944 INFO:teuthology.orchestra.run.smithi094.stdout: thermald 2024-09-13T17:52:34.012 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-13T17:52:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: linux-headers-5.4.0-195 linux-headers-5.4.0-195-generic 2024-09-13T17:52:34.012 INFO:teuthology.orchestra.run.smithi094.stdout: linux-image-5.4.0-195-generic linux-modules-5.4.0-195-generic 2024-09-13T17:52:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: linux-modules-extra-5.4.0-195-generic 2024-09-13T17:52:34.014 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-09-13T17:52:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-13T17:52:34.066 INFO:teuthology.orchestra.run.smithi088.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T17:52:34.067 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 77.2 MB of archives. 2024-09-13T17:52:34.067 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T17:52:34.067 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T17:52:34.072 INFO:teuthology.orchestra.run.smithi094.stdout:3 upgraded, 5 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T17:52:34.072 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 77.2 MB of archives. 2024-09-13T17:52:34.072 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 381 MB of additional disk space will be used. 2024-09-13T17:52:34.072 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-195-generic amd64 5.4.0-195.215 [15.0 MB] 2024-09-13T17:52:34.369 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T17:52:34.460 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T17:52:34.937 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T17:52:34.937 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T17:52:34.937 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T17:52:35.031 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T17:52:35.042 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T17:52:35.321 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-195-generic amd64 5.4.0-195.215 [10.5 MB] 2024-09-13T17:52:35.594 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-195-generic amd64 5.4.0-195.215 [39.2 MB] 2024-09-13T17:52:35.697 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 77.2 MB in 1s (75.7 MB/s) 2024-09-13T17:52:35.886 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T17:52:36.904 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.195.193 [1,900 B] 2024-09-13T17:52:36.904 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.195.193 [2,584 B] 2024-09-13T17:52:36.905 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195 all 5.4.0-195.215 [11.0 MB] 2024-09-13T17:52:37.179 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-195-generic amd64 5.4.0-195.215 [1,386 kB] 2024-09-13T17:52:37.251 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.195.193 [2,460 B] 2024-09-13T17:52:37.642 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T17:52:37.646 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:37.742 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:37.928 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 77.2 MB in 3s (23.0 MB/s) 2024-09-13T17:52:38.130 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-5.4.0-195-generic. 2024-09-13T17:52:39.569 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T17:52:39.586 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:39.689 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:39.874 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-09-13T17:52:39.878 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../0-linux-modules-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:39.952 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:40.789 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T17:52:40.805 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:40.847 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:41.836 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-image-5.4.0-195-generic. 2024-09-13T17:52:41.850 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../1-linux-image-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:41.957 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:43.048 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-195-generic. 2024-09-13T17:52:43.061 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:43.106 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:45.670 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:45.798 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:46.174 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:46.302 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:46.613 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T17:52:46.626 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T17:52:46.663 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T17:52:48.113 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../3-linux-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:48.236 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:48.580 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:48.732 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-image-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:49.059 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.4.0-195. 2024-09-13T17:52:49.073 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../5-linux-headers-5.4.0-195_5.4.0-195.215_all.deb ... 2024-09-13T17:52:49.117 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T17:52:51.890 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T17:52:51.912 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:51.957 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:54.432 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package linux-headers-5.4.0-195-generic. 2024-09-13T17:52:54.454 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../6-linux-headers-5.4.0-195-generic_5.4.0-195.215_amd64.deb ... 2024-09-13T17:52:54.498 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:54.523 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:54.751 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:55.110 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:56.316 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:57.153 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.195.193_amd64.deb ... 2024-09-13T17:52:57.275 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking linux-headers-generic (5.4.0.195.193) over (5.4.0.124.125) ... 2024-09-13T17:52:57.452 INFO:teuthology.orchestra.run.smithi094.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:52:57.452 INFO:teuthology.orchestra.run.smithi094.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T17:52:57.577 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:57.951 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:58.729 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T17:52:58.855 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T17:52:58.981 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:59.107 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T17:52:59.191 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:59.233 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T17:52:59.359 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:52:59.430 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T17:52:59.430 INFO:teuthology.orchestra.run.smithi094.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:00.337 INFO:teuthology.orchestra.run.smithi088.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:53:00.337 INFO:teuthology.orchestra.run.smithi088.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:00.476 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-modules-extra-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:53:01.661 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.4.0-195 (5.4.0-195.215) ... 2024-09-13T17:53:01.787 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-image-generic (5.4.0.195.193) ... 2024-09-13T17:53:01.913 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:53:02.047 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-headers-generic (5.4.0.195.193) ... 2024-09-13T17:53:02.178 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up linux-generic (5.4.0.195.193) ... 2024-09-13T17:53:02.317 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for linux-image-5.4.0-195-generic (5.4.0-195.215) ... 2024-09-13T17:53:02.383 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-13T17:53:02.383 INFO:teuthology.orchestra.run.smithi088.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:21.989 INFO:teuthology.orchestra.run.smithi094.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T17:53:21.989 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub' 2024-09-13T17:53:22.002 INFO:teuthology.orchestra.run.smithi094.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:53:22.019 INFO:teuthology.orchestra.run.smithi094.stdout:Generating grub configuration file ... 2024-09-13T17:53:22.300 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:53:22.327 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:22.712 INFO:teuthology.orchestra.run.smithi094.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:53:22.724 INFO:teuthology.orchestra.run.smithi094.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:53:23.899 INFO:teuthology.orchestra.run.smithi088.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-13T17:53:23.899 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub' 2024-09-13T17:53:23.908 INFO:teuthology.orchestra.run.smithi088.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:53:23.917 INFO:teuthology.orchestra.run.smithi088.stdout:Generating grub configuration file ... 2024-09-13T17:53:24.271 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:53:24.292 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:24.714 INFO:teuthology.orchestra.run.smithi088.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:53:24.721 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-09-13T17:53:24.726 INFO:teuthology.orchestra.run.smithi088.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:53:25.132 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-09-13T17:53:25.212 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.195.193 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T17:53:25.213 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:53:25.214 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-09-13T17:53:25.214 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-09-13T17:53:25.214 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:53:25.214 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-09-13T17:53:25.214 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T17:53:25.214 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:53:25.214 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:53:25.214 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-13T17:53:25.215 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:53:25.215 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get clean 2024-09-13T17:53:25.297 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-13T17:53:25.427 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:53:25.433 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:53:25.450 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:53:25.546 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:53:27.297 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T17:53:27.324 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:53:27.394 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T17:53:27.409 INFO:teuthology.orchestra.run.smithi088.stdout:done 2024-09-13T17:53:27.612 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-13T17:53:27.613 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-13T17:53:27.827 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-09-13T17:53:27.850 INFO:teuthology.orchestra.run.smithi094.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T17:53:27.850 INFO:teuthology.orchestra.run.smithi094.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T17:53:27.852 DEBUG:teuthology.orchestra.run.smithi094:> dpkg -s linux-image-generic 2024-09-13T17:53:27.875 INFO:teuthology.orchestra.run.smithi094.stdout:Package: linux-image-generic 2024-09-13T17:53:27.875 INFO:teuthology.orchestra.run.smithi094.stdout:Status: install ok installed 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Priority: optional 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Section: kernel 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Installed-Size: 20 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: amd64 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Source: linux-meta 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Version: 5.4.0.195.193 2024-09-13T17:53:27.876 INFO:teuthology.orchestra.run.smithi094.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T17:53:27.877 INFO:teuthology.orchestra.run.smithi094.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:53:27.877 INFO:teuthology.orchestra.run.smithi094.stdout:Recommends: thermald 2024-09-13T17:53:27.877 INFO:teuthology.orchestra.run.smithi094.stdout:Description: Generic Linux kernel image 2024-09-13T17:53:27.877 INFO:teuthology.orchestra.run.smithi094.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:53:27.877 INFO:teuthology.orchestra.run.smithi094.stdout: available. 2024-09-13T17:53:27.877 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-13T17:53:27.878 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 20 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.4.0.195.193 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T17:53:27.879 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:53:27.880 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-09-13T17:53:27.880 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-09-13T17:53:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:53:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-09-13T17:53:27.880 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-195-generic 2024-09-13T17:53:27.880 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T17:53:27.880 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T17:53:27.881 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-13T17:53:27.881 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T17:53:27.881 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get clean 2024-09-13T17:53:27.885 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.dl4g2jpqLM 2024-09-13T17:53:27.886 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub/grub.cfg /tmp/tmp.dl4g2jpqLM 2024-09-13T17:53:27.943 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.dl4g2jpqLM 2024-09-13T17:53:27.973 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-09-13T17:53:27.984 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.dl4g2jpqLM is 9KB 2024-09-13T17:53:27.998 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.dl4g2jpqLM 2024-09-13T17:53:28.003 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T17:53:28.059 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T17:53:28.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T17:53:28.059 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T17:53:28.100 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T17:53:28.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo update-grub 2024-09-13T17:53:28.106 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T17:53:28.224 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T17:53:28.305 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T17:53:28.392 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T17:53:29.548 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:53:29.559 INFO:teuthology.orchestra.run.smithi094.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:53:29.568 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-09-13T17:53:29.825 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:53:29.838 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:29.978 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T17:53:30.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-13T17:53:30.075 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T17:53:30.261 INFO:teuthology.orchestra.run.smithi094.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:53:30.272 INFO:teuthology.orchestra.run.smithi094.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:53:30.282 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-09-13T17:53:30.283 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-09-13T17:53:30.511 INFO:teuthology.orchestra.run.smithi088.stdout:linux-image-generic is already the newest version (5.4.0.195.193). 2024-09-13T17:53:30.512 INFO:teuthology.orchestra.run.smithi088.stdout:0 upgraded, 0 newly installed, 0 to remove and 316 not upgraded. 2024-09-13T17:53:30.513 DEBUG:teuthology.orchestra.run.smithi088:> dpkg -s linux-image-generic 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Package: linux-image-generic 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Status: install ok installed 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Priority: optional 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Section: kernel 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Installed-Size: 20 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Maintainer: Ubuntu Kernel Team 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: amd64 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Source: linux-meta 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Version: 5.4.0.195.193 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-09-13T17:53:30.530 INFO:teuthology.orchestra.run.smithi088.stdout:Depends: linux-image-5.4.0-195-generic, linux-modules-extra-5.4.0-195-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-13T17:53:30.531 INFO:teuthology.orchestra.run.smithi088.stdout:Recommends: thermald 2024-09-13T17:53:30.531 INFO:teuthology.orchestra.run.smithi088.stdout:Description: Generic Linux kernel image 2024-09-13T17:53:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: This package will always depend on the latest generic kernel image 2024-09-13T17:53:30.531 INFO:teuthology.orchestra.run.smithi088.stdout: available. 2024-09-13T17:53:30.531 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-09-13T17:53:30.536 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.eWg0uTKMkv 2024-09-13T17:53:30.537 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub/grub.cfg /tmp/tmp.eWg0uTKMkv 2024-09-13T17:53:30.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.eWg0uTKMkv 2024-09-13T17:53:30.622 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.eWg0uTKMkv is 9KB 2024-09-13T17:53:30.636 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.eWg0uTKMkv 2024-09-13T17:53:30.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-13T17:53:30.701 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T17:53:30.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-13T17:53:30.701 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-13T17:53:30.737 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-195-generic 2024-09-13T17:53:30.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo update-grub 2024-09-13T17:53:31.221 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-09-13T17:53:31.222 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-09-13T17:53:32.132 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub' 2024-09-13T17:53:32.138 INFO:teuthology.orchestra.run.smithi088.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-13T17:53:32.149 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-09-13T17:53:32.456 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-195-generic 2024-09-13T17:53:32.468 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-195-generic 2024-09-13T17:53:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-09-13T17:53:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-09-13T17:53:34.534 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-09-13T17:53:34.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-09-13T17:54:01.249 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-13T17:54:01.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T17:54:01.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:04.542 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-13T17:54:04.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:54:04.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:19.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-13T17:54:22.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-13T17:54:28.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T17:54:28.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:31.681 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.94 2024-09-13T17:54:31.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:54:31.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:34.973 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-13T17:54:43.689 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T17:54:43.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:46.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:54:46.977 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:54:50.049 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-13T17:55:05.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:55:05.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:55:15.389 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-13T17:55:15.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T17:55:15.942 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-195-generic"... 2024-09-13T17:55:15.942 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-09-13T17:55:15.948 INFO:teuthology.orchestra.run.smithi094.stdout:5.4.0-195-generic 2024-09-13T17:55:15.948 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T17:55:15.949 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:55:15.949 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:55:16.950 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-13T17:55:16.950 DEBUG:teuthology.orchestra.run.smithi094:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:55:17.049 INFO:teuthology.orchestra.run.smithi094.stdout:ttyS1 2024-09-13T17:55:17.071 DEBUG:teuthology.parallel:result is None 2024-09-13T17:55:23.581 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-09-13T17:55:41.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:55:41.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T17:55:41.838 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-13T17:55:42.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T17:55:42.444 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-195-generic"... 2024-09-13T17:55:42.444 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-09-13T17:55:42.491 INFO:teuthology.orchestra.run.smithi088.stdout:5.4.0-195-generic 2024-09-13T17:55:42.492 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-195-generic vs 5.4.0-195-generic 2024-09-13T17:55:42.492 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T17:55:42.492 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-13T17:55:43.492 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-13T17:55:43.493 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T17:55:43.596 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-09-13T17:55:43.624 DEBUG:teuthology.parallel:result is None 2024-09-13T17:55:43.624 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T17:55:43.632 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T17:55:43.632 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:55:43.634 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T17:55:43.641 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T17:55:43.651 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T17:55:43.660 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T17:55:43.661 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:55:43.683 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T17:55:43.712 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T17:55:43.719 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T17:55:43.719 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:55:43.721 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T17:55:43.744 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:55:43.754 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:55:43.776 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:55:43.787 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T17:55:43.789 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T17:55:43.799 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T17:55:43.800 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:55:43.803 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T17:55:43.819 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T17:55:43.828 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T17:55:43.828 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:55:43.830 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T17:55:43.868 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:55:43.884 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:55:43.891 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T17:55:43.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:55:43.914 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T17:55:43.922 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T17:55:43.929 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T17:55:43.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T17:55:43.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-09-13T17:55:44.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-09-13T17:55:44.053 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T17:55:44.061 INFO:teuthology.task.internal:Starting timer... 2024-09-13T17:55:44.061 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T17:55:44.075 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T17:55:44.083 DEBUG:teuthology.task.selinux:Excluding smithi088: OS 'ubuntu' does not support SELinux 2024-09-13T17:55:44.083 DEBUG:teuthology.task.selinux:Excluding smithi094: OS 'ubuntu' does not support SELinux 2024-09-13T17:55:44.083 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T17:55:44.083 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-13T17:55:44.084 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T17:55:44.084 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T17:55:44.094 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T17:55:44.106 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T17:55:44.107 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi094.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:01:19.947 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com')] 2024-09-13T18:01:19.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T18:01:19.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:01:20.063 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-09-13T18:01:20.186 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-09-13T18:01:20.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T18:01:20.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:01:20.295 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-09-13T18:01:20.418 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-09-13T18:01:20.418 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:01:20.428 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:01:20.428 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:01:20.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:01:20.431 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:01:20.431 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:01:20.461 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:01:20.462 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Command line: ntpd -gq 2024-09-13T18:01:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: proto: precision = 0.106 usec (-23) 2024-09-13T18:01:20.463 INFO:teuthology.orchestra.run.smithi088.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:01:20.463 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:01:20.464 INFO:teuthology.orchestra.run.smithi088.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen normally on 3 enp3s0f1 172.21.15.88:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen normally on 4 lo [::1]:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d42d%5]:123 2024-09-13T18:01:20.465 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:20 ntpd[13752]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:01:20.466 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-09-13T18:01:20.466 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Command line: ntpd -gq 2024-09-13T18:01:20.467 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: proto: precision = 0.064 usec (-24) 2024-09-13T18:01:20.468 INFO:teuthology.orchestra.run.smithi094.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:01:20.468 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-13T18:01:20.468 INFO:teuthology.orchestra.run.smithi094.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:01:20.469 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: restrict ::: KOD does nothing without LIMITED. 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen and drop on 0 v6wildcard [::]:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen normally on 2 lo 127.0.0.1:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen normally on 3 enp3s0f1 172.21.15.94:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen normally on 4 lo [::1]:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d763%5]:123 2024-09-13T18:01:20.470 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:20 ntpd[13805]: Listening on routing socket on fd #22 for interface updates 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:21.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:21.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:21 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:21.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:21 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:21.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:21 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:22.462 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:22.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:22 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:23.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:23.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:23.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:23.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:23.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:23 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:24.462 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:24.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:24 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:24.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:24.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:24.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:24.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:24.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:24.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:24 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:25 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:25.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:25 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:26.462 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:26.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:26 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:26.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:26.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:26.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:26.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:26.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:26.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:26 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:27.463 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:27.464 INFO:teuthology.orchestra.run.smithi088.stdout:13 Sep 18:01:27 ntpd[13752]: ntpd: time slew +0.000902 s 2024-09-13T18:01:27.464 INFO:teuthology.orchestra.run.smithi088.stdout:ntpd: time slew +0.000902s 2024-09-13T18:01:27.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:01:27.464 INFO:teuthology.orchestra.run.smithi088.stderr:13 Sep 18:01:27 ntpd[13752]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:27.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:27 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:27.530 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:01:27.530 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-09-13T18:01:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:27.531 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:28.467 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:28.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:28 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:29.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:29.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:29 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: can't open /var/log/ntpstats/rawstats.20240913: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: can't open /var/log/ntpstats/peerstats.20240913: Permission denied 2024-09-13T18:01:30.468 INFO:teuthology.orchestra.run.smithi094.stdout:13 Sep 18:01:30 ntpd[13805]: ntpd: time slew +0.004847 s 2024-09-13T18:01:30.469 INFO:teuthology.orchestra.run.smithi094.stdout:ntpd: time slew +0.004847s 2024-09-13T18:01:30.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-13T18:01:30.469 INFO:teuthology.orchestra.run.smithi094.stderr:13 Sep 18:01:30 ntpd[13805]: can't open /var/log/ntpstats/loopstats.20240913: Permission denied 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:30.538 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-09-13T18:01:30.539 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:01:30.547 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:01:30.547 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:01:30.547 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:01:30.547 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:01:30.554 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:01:30.554 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:01:30.555 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-key list | grep Ceph 2024-09-13T18:01:30.555 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-key list | grep Ceph 2024-09-13T18:01:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:01:30.688 INFO:teuthology.orchestra.run.smithi094.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-09-13T18:01:30.719 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:01:30.719 INFO:teuthology.orchestra.run.smithi088.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:01:30.720 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:01:30.720 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:01:30.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:01:30.748 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-13T18:01:30.748 INFO:teuthology.orchestra.run.smithi094.stdout:uid [ unknown] Ceph.com (release key) 2024-09-13T18:01:30.749 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-13T18:01:30.749 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-13T18:01:30.749 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:01:30.876 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:01:30.876 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:01:30.891 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default/ 2024-09-13T18:01:30.891 INFO:teuthology.task.install.deb:Package version is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:01:31.102 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:01:31.102 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:01:31.118 DEBUG:teuthology.orchestra.run.smithi088:> sudo apt-get update 2024-09-13T18:01:31.123 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:01:31.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-13T18:01:31.140 DEBUG:teuthology.orchestra.run.smithi094:> sudo apt-get update 2024-09-13T18:01:31.261 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:01:31.376 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:01:31.439 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:01:31.460 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:01:31.461 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-09-13T18:01:31.461 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-09-13T18:01:31.491 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:01:31.501 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal InRelease 2024-09-13T18:01:31.530 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-09-13T18:01:31.539 INFO:teuthology.orchestra.run.smithi088.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:01:31.539 INFO:teuthology.orchestra.run.smithi088.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:01:31.553 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-09-13T18:01:31.590 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:01:31.601 INFO:teuthology.orchestra.run.smithi094.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal Release.gpg 2024-09-13T18:01:31.611 INFO:teuthology.orchestra.run.smithi094.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-09-13T18:01:31.652 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:01:31.653 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 Packages [17.6 kB] 2024-09-13T18:01:31.713 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main i386 Packages [3,433 B] 2024-09-13T18:01:31.923 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 28.7 kB in 1s (45.0 kB/s) 2024-09-13T18:01:32.100 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 28.7 kB in 1s (38.1 kB/s) 2024-09-13T18:01:33.085 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T18:01:33.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:01:33.188 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T18:01:33.260 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T18:01:33.285 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.4-860-g6c6b083f-1focal cephadm=18.2.4-860-g6c6b083f-1focal ceph-mds=18.2.4-860-g6c6b083f-1focal ceph-mgr=18.2.4-860-g6c6b083f-1focal ceph-common=18.2.4-860-g6c6b083f-1focal ceph-fuse=18.2.4-860-g6c6b083f-1focal ceph-test=18.2.4-860-g6c6b083f-1focal ceph-volume=18.2.4-860-g6c6b083f-1focal radosgw=18.2.4-860-g6c6b083f-1focal python3-rados=18.2.4-860-g6c6b083f-1focal python3-rgw=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal python3-rbd=18.2.4-860-g6c6b083f-1focal libcephfs2=18.2.4-860-g6c6b083f-1focal libcephfs-dev=18.2.4-860-g6c6b083f-1focal librados2=18.2.4-860-g6c6b083f-1focal librbd1=18.2.4-860-g6c6b083f-1focal rbd-fuse=18.2.4-860-g6c6b083f-1focal python3-cephfs=18.2.4-860-g6c6b083f-1focal cephfs-shell=18.2.4-860-g6c6b083f-1focal cephfs-top=18.2.4-860-g6c6b083f-1focal cephfs-mirror=18.2.4-860-g6c6b083f-1focal 2024-09-13T18:01:33.356 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T18:01:33.406 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-09-13T18:01:33.407 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-09-13T18:01:33.550 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-13T18:01:33.551 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-13T18:01:33.603 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:01:33.605 INFO:teuthology.orchestra.run.smithi088.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:01:33.606 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:01:33.607 INFO:teuthology.orchestra.run.smithi088.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout:Recommended packages: 2024-09-13T18:01:33.608 INFO:teuthology.orchestra.run.smithi088.stdout: btrfs-tools 2024-09-13T18:01:33.734 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:01:33.735 INFO:teuthology.orchestra.run.smithi088.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:01:33.736 INFO:teuthology.orchestra.run.smithi088.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:01:33.737 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:01:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:01:33.738 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-09-13T18:01:33.738 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 librbd1 2024-09-13T18:01:33.745 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:01:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:01:33.747 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:01:33.747 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-13T18:01:33.747 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-13T18:01:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-09-13T18:01:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-09-13T18:01:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-09-13T18:01:33.748 INFO:teuthology.orchestra.run.smithi094.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-09-13T18:01:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-09-13T18:01:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:01:33.749 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:01:33.750 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n socat xmlstarlet 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-09-13T18:01:33.751 INFO:teuthology.orchestra.run.smithi094.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout:Recommended packages: 2024-09-13T18:01:33.752 INFO:teuthology.orchestra.run.smithi094.stdout: btrfs-tools 2024-09-13T18:01:33.804 INFO:teuthology.orchestra.run.smithi088.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T18:01:33.804 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 200 MB of archives. 2024-09-13T18:01:33.804 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:01:33.804 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:01:33.822 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:01:33.830 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:01:33.856 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:01:33.870 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-13T18:01:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-13T18:01:33.870 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-13T18:01:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-13T18:01:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2024-09-13T18:01:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2024-09-13T18:01:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2024-09-13T18:01:33.871 INFO:teuthology.orchestra.run.smithi094.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2024-09-13T18:01:33.873 INFO:teuthology.orchestra.run.smithi094.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-09-13T18:01:33.874 INFO:teuthology.orchestra.run.smithi094.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2024-09-13T18:01:33.875 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-09-13T18:01:33.875 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 librbd1 2024-09-13T18:01:33.886 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:01:33.889 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:01:33.902 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:01:33.945 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:01:33.947 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:01:33.953 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:01:33.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:01:33.955 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:01:33.956 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:01:33.956 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:01:33.959 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:01:33.959 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:01:33.962 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:01:33.978 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:01:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:01:33.979 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:01:33.981 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:01:33.981 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:01:33.982 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:01:33.983 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:01:33.984 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:01:33.985 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:01:33.997 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:01:34.005 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:01:34.010 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:01:34.011 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:01:34.011 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:01:34.012 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:01:34.013 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:01:34.015 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:01:34.016 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:01:34.018 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:01:34.031 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:01:34.032 INFO:teuthology.orchestra.run.smithi088.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:01:34.034 INFO:teuthology.orchestra.run.smithi088.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:01:34.034 INFO:teuthology.orchestra.run.smithi088.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:01:34.035 INFO:teuthology.orchestra.run.smithi088.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:01:34.037 INFO:teuthology.orchestra.run.smithi088.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:01:34.048 INFO:teuthology.orchestra.run.smithi088.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:01:34.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:01:34.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:01:34.050 INFO:teuthology.orchestra.run.smithi088.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:01:34.053 INFO:teuthology.orchestra.run.smithi088.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:01:34.065 INFO:teuthology.orchestra.run.smithi088.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:01:34.067 INFO:teuthology.orchestra.run.smithi088.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:01:34.068 INFO:teuthology.orchestra.run.smithi094.stdout:2 upgraded, 116 newly installed, 0 to remove and 295 not upgraded. 2024-09-13T18:01:34.068 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 200 MB of archives. 2024-09-13T18:01:34.068 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 979 MB of additional disk space will be used. 2024-09-13T18:01:34.068 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2024-09-13T18:01:34.069 INFO:teuthology.orchestra.run.smithi088.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:01:34.071 INFO:teuthology.orchestra.run.smithi088.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:01:34.071 INFO:teuthology.orchestra.run.smithi088.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:01:34.082 INFO:teuthology.orchestra.run.smithi088.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:01:34.151 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-09-13T18:01:34.163 INFO:teuthology.orchestra.run.smithi088.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:01:34.167 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.4-860-g6c6b083f-1focal [3,453 kB] 2024-09-13T18:01:34.182 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2024-09-13T18:01:34.221 INFO:teuthology.orchestra.run.smithi088.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:01:34.223 INFO:teuthology.orchestra.run.smithi088.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:01:34.238 INFO:teuthology.orchestra.run.smithi088.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:01:34.238 INFO:teuthology.orchestra.run.smithi088.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:01:34.241 INFO:teuthology.orchestra.run.smithi088.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:01:34.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:01:34.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:01:34.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:01:34.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:01:34.242 INFO:teuthology.orchestra.run.smithi088.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:01:34.255 INFO:teuthology.orchestra.run.smithi088.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:01:34.256 INFO:teuthology.orchestra.run.smithi088.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:01:34.258 INFO:teuthology.orchestra.run.smithi088.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:01:34.272 INFO:teuthology.orchestra.run.smithi088.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:01:34.275 INFO:teuthology.orchestra.run.smithi088.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:01:34.276 INFO:teuthology.orchestra.run.smithi088.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:01:34.280 INFO:teuthology.orchestra.run.smithi088.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:01:34.283 INFO:teuthology.orchestra.run.smithi088.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:01:34.283 INFO:teuthology.orchestra.run.smithi088.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:01:34.297 INFO:teuthology.orchestra.run.smithi088.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:01:34.300 INFO:teuthology.orchestra.run.smithi088.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:01:34.301 INFO:teuthology.orchestra.run.smithi088.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:01:34.309 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-09-13T18:01:34.345 INFO:teuthology.orchestra.run.smithi088.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:01:34.345 INFO:teuthology.orchestra.run.smithi088.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:01:34.345 INFO:teuthology.orchestra.run.smithi088.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:01:34.346 INFO:teuthology.orchestra.run.smithi088.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:01:34.357 INFO:teuthology.orchestra.run.smithi088.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:01:34.357 INFO:teuthology.orchestra.run.smithi088.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:01:34.358 INFO:teuthology.orchestra.run.smithi088.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:01:34.359 INFO:teuthology.orchestra.run.smithi088.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:01:34.359 INFO:teuthology.orchestra.run.smithi088.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:01:34.438 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-09-13T18:01:34.454 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-09-13T18:01:34.488 INFO:teuthology.orchestra.run.smithi088.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:01:34.515 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-09-13T18:01:34.593 INFO:teuthology.orchestra.run.smithi088.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:01:34.616 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.4-860-g6c6b083f-1focal [4,041 kB] 2024-09-13T18:01:34.637 INFO:teuthology.orchestra.run.smithi088.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:01:34.643 INFO:teuthology.orchestra.run.smithi088.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:01:34.643 INFO:teuthology.orchestra.run.smithi088.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:01:34.645 INFO:teuthology.orchestra.run.smithi088.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:01:34.647 INFO:teuthology.orchestra.run.smithi088.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:01:34.653 INFO:teuthology.orchestra.run.smithi088.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:01:34.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-09-13T18:01:34.722 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-09-13T18:01:34.731 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.4-860-g6c6b083f-1focal [747 kB] 2024-09-13T18:01:34.746 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-09-13T18:01:34.754 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-09-13T18:01:34.754 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-09-13T18:01:34.759 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-09-13T18:01:34.760 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-09-13T18:01:34.772 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-09-13T18:01:34.773 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-09-13T18:01:34.774 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.4-860-g6c6b083f-1focal [388 kB] 2024-09-13T18:01:34.782 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.4-860-g6c6b083f-1focal [31.9 kB] 2024-09-13T18:01:34.782 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.4-860-g6c6b083f-1focal [200 kB] 2024-09-13T18:01:34.784 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.4-860-g6c6b083f-1focal [62.5 kB] 2024-09-13T18:01:34.784 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.4-860-g6c6b083f-1focal [368 kB] 2024-09-13T18:01:34.790 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.4-860-g6c6b083f-1focal [6,634 kB] 2024-09-13T18:01:34.792 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-09-13T18:01:34.859 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-09-13T18:01:34.860 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-09-13T18:01:34.861 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-09-13T18:01:34.863 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-13T18:01:34.863 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-09-13T18:01:34.864 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-webob all 1:1.8.5-2ubuntu0.1 [84.5 kB] 2024-09-13T18:01:34.867 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-09-13T18:01:34.868 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-09-13T18:01:34.868 INFO:teuthology.orchestra.run.smithi088.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:01:34.869 INFO:teuthology.orchestra.run.smithi088.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:01:34.874 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-09-13T18:01:34.877 INFO:teuthology.orchestra.run.smithi088.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:01:34.955 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-09-13T18:01:34.955 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-09-13T18:01:34.964 INFO:teuthology.orchestra.run.smithi094.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-09-13T18:01:34.965 INFO:teuthology.orchestra.run.smithi094.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-09-13T18:01:34.966 INFO:teuthology.orchestra.run.smithi094.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-09-13T18:01:34.967 INFO:teuthology.orchestra.run.smithi094.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-09-13T18:01:34.969 INFO:teuthology.orchestra.run.smithi094.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.2 [183 kB] 2024-09-13T18:01:34.971 INFO:teuthology.orchestra.run.smithi094.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-09-13T18:01:35.032 INFO:teuthology.orchestra.run.smithi094.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.4-860-g6c6b083f-1focal [113 kB] 2024-09-13T18:01:35.033 INFO:teuthology.orchestra.run.smithi094.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.4-860-g6c6b083f-1focal [478 kB] 2024-09-13T18:01:35.036 INFO:teuthology.orchestra.run.smithi094.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-09-13T18:01:35.041 INFO:teuthology.orchestra.run.smithi094.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-09-13T18:01:35.043 INFO:teuthology.orchestra.run.smithi094.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.4-860-g6c6b083f-1focal [25.2 MB] 2024-09-13T18:01:35.117 INFO:teuthology.orchestra.run.smithi094.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-09-13T18:01:35.121 INFO:teuthology.orchestra.run.smithi094.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.3 [96.0 kB] 2024-09-13T18:01:35.123 INFO:teuthology.orchestra.run.smithi094.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-09-13T18:01:35.124 INFO:teuthology.orchestra.run.smithi094.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-09-13T18:01:35.125 INFO:teuthology.orchestra.run.smithi094.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-09-13T18:01:35.127 INFO:teuthology.orchestra.run.smithi094.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-09-13T18:01:35.128 INFO:teuthology.orchestra.run.smithi094.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-09-13T18:01:35.129 INFO:teuthology.orchestra.run.smithi094.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-09-13T18:01:35.198 INFO:teuthology.orchestra.run.smithi094.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-09-13T18:01:35.202 INFO:teuthology.orchestra.run.smithi094.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-13T18:01:35.280 INFO:teuthology.orchestra.run.smithi094.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-09-13T18:01:35.282 INFO:teuthology.orchestra.run.smithi094.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-09-13T18:01:35.285 INFO:teuthology.orchestra.run.smithi094.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-09-13T18:01:35.287 INFO:teuthology.orchestra.run.smithi094.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-09-13T18:01:35.288 INFO:teuthology.orchestra.run.smithi094.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-09-13T18:01:35.289 INFO:teuthology.orchestra.run.smithi094.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-09-13T18:01:35.609 INFO:teuthology.orchestra.run.smithi094.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-09-13T18:01:35.640 INFO:teuthology.orchestra.run.smithi094.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-09-13T18:01:35.642 INFO:teuthology.orchestra.run.smithi094.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-09-13T18:01:35.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-09-13T18:01:35.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-09-13T18:01:35.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-09-13T18:01:35.711 INFO:teuthology.orchestra.run.smithi094.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-09-13T18:01:35.711 INFO:teuthology.orchestra.run.smithi094.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-09-13T18:01:35.711 INFO:teuthology.orchestra.run.smithi094.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-09-13T18:01:35.712 INFO:teuthology.orchestra.run.smithi094.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-09-13T18:01:35.762 INFO:teuthology.orchestra.run.smithi088.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:01:35.773 INFO:teuthology.orchestra.run.smithi094.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-09-13T18:01:35.773 INFO:teuthology.orchestra.run.smithi094.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-09-13T18:01:35.854 INFO:teuthology.orchestra.run.smithi094.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-09-13T18:01:35.859 INFO:teuthology.orchestra.run.smithi094.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-09-13T18:01:35.862 INFO:teuthology.orchestra.run.smithi094.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-09-13T18:01:35.865 INFO:teuthology.orchestra.run.smithi094.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-09-13T18:01:35.866 INFO:teuthology.orchestra.run.smithi094.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-09-13T18:01:35.870 INFO:teuthology.orchestra.run.smithi094.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-09-13T18:01:35.872 INFO:teuthology.orchestra.run.smithi094.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2024-09-13T18:01:35.872 INFO:teuthology.orchestra.run.smithi094.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-09-13T18:01:35.946 INFO:teuthology.orchestra.run.smithi094.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.2 [283 kB] 2024-09-13T18:01:35.950 INFO:teuthology.orchestra.run.smithi094.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-09-13T18:01:36.005 INFO:teuthology.orchestra.run.smithi088.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:01:36.009 INFO:teuthology.orchestra.run.smithi088.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:01:36.015 INFO:teuthology.orchestra.run.smithi088.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:01:36.016 INFO:teuthology.orchestra.run.smithi094.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-09-13T18:01:36.054 INFO:teuthology.orchestra.run.smithi088.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:01:36.070 INFO:teuthology.orchestra.run.smithi094.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.4-860-g6c6b083f-1focal [9,609 kB] 2024-09-13T18:01:36.130 INFO:teuthology.orchestra.run.smithi094.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-09-13T18:01:36.131 INFO:teuthology.orchestra.run.smithi094.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-09-13T18:01:36.180 INFO:teuthology.orchestra.run.smithi094.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-09-13T18:01:36.182 INFO:teuthology.orchestra.run.smithi094.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-09-13T18:01:36.200 INFO:teuthology.orchestra.run.smithi094.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-13T18:01:36.201 INFO:teuthology.orchestra.run.smithi094.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-09-13T18:01:36.202 INFO:teuthology.orchestra.run.smithi094.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-09-13T18:01:36.202 INFO:teuthology.orchestra.run.smithi094.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-09-13T18:01:36.202 INFO:teuthology.orchestra.run.smithi094.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-09-13T18:01:36.262 INFO:teuthology.orchestra.run.smithi088.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:01:36.362 INFO:teuthology.orchestra.run.smithi094.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.4-860-g6c6b083f-1focal [238 kB] 2024-09-13T18:01:36.364 INFO:teuthology.orchestra.run.smithi094.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.4-860-g6c6b083f-1focal [147 kB] 2024-09-13T18:01:36.366 INFO:teuthology.orchestra.run.smithi094.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.4-860-g6c6b083f-1focal [1,576 kB] 2024-09-13T18:01:36.423 INFO:teuthology.orchestra.run.smithi094.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.4-860-g6c6b083f-1focal [6,641 kB] 2024-09-13T18:01:36.668 INFO:teuthology.orchestra.run.smithi094.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.4-860-g6c6b083f-1focal [24.5 MB] 2024-09-13T18:01:37.132 INFO:teuthology.orchestra.run.smithi088.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:01:37.133 INFO:teuthology.orchestra.run.smithi088.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:01:37.145 INFO:teuthology.orchestra.run.smithi088.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:01:37.162 INFO:teuthology.orchestra.run.smithi088.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:01:37.163 INFO:teuthology.orchestra.run.smithi088.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:01:37.165 INFO:teuthology.orchestra.run.smithi088.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:01:37.369 INFO:teuthology.orchestra.run.smithi088.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:01:37.586 INFO:teuthology.orchestra.run.smithi088.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:01:37.586 INFO:teuthology.orchestra.run.smithi088.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:01:37.609 INFO:teuthology.orchestra.run.smithi094.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.4-860-g6c6b083f-1focal [13.7 kB] 2024-09-13T18:01:37.610 INFO:teuthology.orchestra.run.smithi094.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.4-860-g6c6b083f-1focal [857 kB] 2024-09-13T18:01:37.625 INFO:teuthology.orchestra.run.smithi094.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.4-860-g6c6b083f-1focal [2,296 kB] 2024-09-13T18:01:37.644 INFO:teuthology.orchestra.run.smithi094.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.4-860-g6c6b083f-1focal [239 kB] 2024-09-13T18:01:37.648 INFO:teuthology.orchestra.run.smithi094.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.4-860-g6c6b083f-1focal [143 kB] 2024-09-13T18:01:37.650 INFO:teuthology.orchestra.run.smithi094.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.4-860-g6c6b083f-1focal [7,015 kB] 2024-09-13T18:01:37.900 INFO:teuthology.orchestra.run.smithi094.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.4-860-g6c6b083f-1focal [7,894 kB] 2024-09-13T18:01:38.195 INFO:teuthology.orchestra.run.smithi094.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.4-860-g6c6b083f-1focal [13.9 kB] 2024-09-13T18:01:38.196 INFO:teuthology.orchestra.run.smithi094.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.4-860-g6c6b083f-1focal [47.1 MB] 2024-09-13T18:01:39.266 INFO:teuthology.orchestra.run.smithi088.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:01:39.269 INFO:teuthology.orchestra.run.smithi088.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:01:39.274 INFO:teuthology.orchestra.run.smithi088.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:01:39.275 INFO:teuthology.orchestra.run.smithi088.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:01:39.276 INFO:teuthology.orchestra.run.smithi088.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:01:39.277 INFO:teuthology.orchestra.run.smithi088.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:01:39.618 INFO:teuthology.orchestra.run.smithi088.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:01:40.237 INFO:teuthology.orchestra.run.smithi094.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.4-860-g6c6b083f-1focal [120 kB] 2024-09-13T18:01:40.239 INFO:teuthology.orchestra.run.smithi094.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.4-860-g6c6b083f-1focal [271 kB] 2024-09-13T18:01:40.245 INFO:teuthology.orchestra.run.smithi094.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.4-860-g6c6b083f-1focal [33.0 kB] 2024-09-13T18:01:40.246 INFO:teuthology.orchestra.run.smithi094.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.4-860-g6c6b083f-1focal [22.8 kB] 2024-09-13T18:01:40.265 INFO:teuthology.orchestra.run.smithi094.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.4-860-g6c6b083f-1focal [37.4 kB] 2024-09-13T18:01:40.266 INFO:teuthology.orchestra.run.smithi094.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.4-860-g6c6b083f-1focal [13.5 MB] 2024-09-13T18:01:40.269 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 200 MB in 6s (34.0 MB/s) 2024-09-13T18:01:40.414 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:01:40.469 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T18:01:40.473 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:01:40.520 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:01:40.569 INFO:teuthology.orchestra.run.smithi094.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.4-860-g6c6b083f-1focal [108 kB] 2024-09-13T18:01:40.831 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:01:40.851 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:01:40.889 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:01:41.230 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 200 MB in 7s (29.8 MB/s) 2024-09-13T18:01:41.259 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:01:41.275 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:01:41.325 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:01:41.373 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-13T18:01:41.431 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141720 files and directories currently installed.) 2024-09-13T18:01:41.436 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2024-09-13T18:01:41.479 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2024-09-13T18:01:41.737 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:01:41.753 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:01:41.782 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-13T18:01:41.798 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-09-13T18:01:41.837 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:01:41.840 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:01:42.160 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cmd2. 2024-09-13T18:01:42.177 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2024-09-13T18:01:42.210 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:01:42.266 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:01:42.284 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:01:42.324 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:01:42.480 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-09-13T18:01:42.499 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-09-13T18:01:42.580 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:01:42.727 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:01:42.742 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:01:42.785 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:01:42.917 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-13T18:01:42.936 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-09-13T18:01:42.975 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:01:43.288 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:01:43.305 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:43.337 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-13T18:01:43.353 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-09-13T18:01:43.390 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:43.395 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:01:43.774 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-13T18:01:43.789 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:43.842 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:43.958 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:01:43.974 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:44.016 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:44.377 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-13T18:01:44.393 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:44.435 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:44.436 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:01:44.453 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:44.494 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:44.756 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-13T18:01:44.773 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-09-13T18:01:44.814 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:01:44.905 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:01:44.922 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:01:44.964 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:01:45.167 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-09-13T18:01:45.187 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-09-13T18:01:45.225 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:01:45.357 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:45.509 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:01:45.623 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../010-librbd1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:45.746 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librbd1 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:01:46.248 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:46.371 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:01:46.440 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../011-librados2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:46.542 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librados2 (18.2.4-860-g6c6b083f-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-09-13T18:01:47.133 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:01:47.150 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:47.191 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:47.263 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs2. 2024-09-13T18:01:47.278 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../012-libcephfs2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:47.321 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:47.584 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:01:47.603 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:47.644 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:47.738 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rados. 2024-09-13T18:01:47.758 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../013-python3-rados_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:47.840 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:48.022 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:01:48.038 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:01:48.097 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:48.126 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-13T18:01:48.142 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:01:48.176 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:48.366 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:01:48.381 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:48.424 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:48.437 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cephfs. 2024-09-13T18:01:48.453 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../015-python3-cephfs_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:48.496 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:48.840 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:01:48.861 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:01:48.898 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:49.069 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-13T18:01:49.085 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:01:49.127 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:49.218 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:01:49.234 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:01:49.277 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:01:49.529 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:01:49.538 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-prettytable. 2024-09-13T18:01:49.546 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:49.556 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2024-09-13T18:01:49.588 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:49.596 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-09-13T18:01:49.849 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rbd. 2024-09-13T18:01:49.865 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../018-python3-rbd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:49.907 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:49.966 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:01:49.982 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:01:50.024 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:01:50.277 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-09-13T18:01:50.293 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-09-13T18:01:50.335 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:01:50.344 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:01:50.361 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:01:50.402 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:01:50.746 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-09-13T18:01:50.747 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:01:50.763 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:01:50.764 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2024-09-13T18:01:50.804 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:01:50.822 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:01:51.142 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:01:51.158 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:51.190 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-13T18:01:51.191 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:51.208 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-09-13T18:01:51.248 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:01:51.635 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package librgw2. 2024-09-13T18:01:51.653 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../022-librgw2_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:51.684 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:52.094 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:01:52.110 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:52.152 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:52.505 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:01:52.521 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:01:52.563 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:01:52.620 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rgw. 2024-09-13T18:01:52.637 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../023-python3-rgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:52.678 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:52.866 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:01:52.884 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:52.925 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:53.089 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liboath0. 2024-09-13T18:01:53.105 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2024-09-13T18:01:53.147 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-09-13T18:01:53.353 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:01:53.369 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:53.411 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:53.475 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libradosstriper1. 2024-09-13T18:01:53.491 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../025-libradosstriper1_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:53.558 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:54.004 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-common. 2024-09-13T18:01:54.023 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../026-ceph-common_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:54.312 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:55.775 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:01:55.791 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:55.836 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:56.783 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-base. 2024-09-13T18:01:56.800 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../027-ceph-base_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:01:56.843 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:01:57.047 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:01:57.065 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:01:57.097 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:01:57.459 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:01:57.474 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:01:57.517 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:01:57.820 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:01:57.837 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:01:57.887 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:01:58.187 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-13T18:01:58.207 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2024-09-13T18:01:58.245 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:01:58.493 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:01:58.512 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:01:58.556 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:01:58.557 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-natsort. 2024-09-13T18:01:58.573 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2024-09-13T18:01:58.632 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-09-13T18:01:58.860 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:01:58.875 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:01:58.918 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:01:58.969 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-logutils. 2024-09-13T18:01:58.985 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2024-09-13T18:01:59.027 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-09-13T18:01:59.246 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:01:59.262 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:01:59.304 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:01:59.438 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-13T18:01:59.456 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-09-13T18:01:59.496 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:01:59.633 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:01:59.649 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:01:59.691 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:01:59.865 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-mako. 2024-09-13T18:01:59.881 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-09-13T18:01:59.923 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:01:59.994 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:02:00.010 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:02:00.052 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:02:00.310 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-13T18:02:00.328 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-13T18:02:00.368 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:02:00.372 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:02:00.389 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:02:00.430 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:02:00.688 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-13T18:02:00.707 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-09-13T18:02:00.741 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:02:00.760 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:02:00.779 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:02:00.799 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:02:01.107 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webob. 2024-09-13T18:02:01.122 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2ubuntu0.1_all.deb ... 2024-09-13T18:02:01.153 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:02:01.165 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:02:01.170 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:02:01.214 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:02:01.539 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:02:01.551 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-soupsieve. 2024-09-13T18:02:01.555 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:02:01.568 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-09-13T18:02:01.597 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:02:01.609 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:02:01.901 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:02:01.920 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:02:01.959 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:02:01.971 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bs4. 2024-09-13T18:02:01.990 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2024-09-13T18:02:02.029 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-09-13T18:02:02.270 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:02:02.288 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:02:02.328 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:02:02.449 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-waitress. 2024-09-13T18:02:02.467 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-09-13T18:02:02.510 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:02:02.597 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:02:02.616 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:02:02.647 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:02:02.852 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-tempita. 2024-09-13T18:02:02.871 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2024-09-13T18:02:02.934 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:02:02.943 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-09-13T18:02:02.952 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:02:02.991 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:02:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-paste. 2024-09-13T18:02:03.294 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-09-13T18:02:03.303 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:02:03.319 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:02:03.336 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:02:03.361 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:02:03.724 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-13T18:02:03.743 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-09-13T18:02:03.781 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:02:04.151 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-13T18:02:04.166 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2024-09-13T18:02:04.209 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:02:04.525 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:02:04.541 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:02:04.582 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:02:04.763 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webtest. 2024-09-13T18:02:04.783 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2024-09-13T18:02:04.861 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:02:04.880 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:04.919 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:05.246 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-09-13T18:02:05.327 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:02:05.343 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:05.385 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:05.713 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:02:05.715 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pecan. 2024-09-13T18:02:05.730 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:02:05.731 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-09-13T18:02:05.771 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:02:05.790 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:02:06.072 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:02:06.092 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:02:06.130 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:02:06.170 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-13T18:02:06.188 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.2_all.deb ... 2024-09-13T18:02:06.253 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:02:06.518 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:02:06.537 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:02:06.556 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-13T18:02:06.575 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:06.576 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:02:06.614 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:06.920 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:02:06.938 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:06.978 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:07.040 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-13T18:02:07.059 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:07.098 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:07.476 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-13T18:02:07.485 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:02:07.493 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../048-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-09-13T18:02:07.504 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:07.533 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:02:07.548 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:07.877 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cryptography. 2024-09-13T18:02:07.896 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../049-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-09-13T18:02:07.927 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:02:08.372 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-openssl. 2024-09-13T18:02:08.389 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../050-python3-openssl_19.0.0-1build1_all.deb ... 2024-09-13T18:02:08.430 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-09-13T18:02:08.435 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:02:08.451 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:08.493 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:08.833 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr. 2024-09-13T18:02:08.849 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../051-ceph-mgr_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:08.891 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:09.353 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mon. 2024-09-13T18:02:09.372 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../052-ceph-mon_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:09.403 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:10.499 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-osd. 2024-09-13T18:02:10.519 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../053-ceph-osd_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:10.557 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:10.780 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph. 2024-09-13T18:02:10.798 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:10.838 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:11.165 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:02:11.182 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:11.223 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:11.601 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:02:11.617 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:11.651 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:12.179 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:02:12.195 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:12.237 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:02:12.582 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:02:12.623 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:02:12.851 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph. 2024-09-13T18:02:12.871 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../054-ceph_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:12.909 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:12.993 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:02:13.010 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:02:13.051 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:02:13.295 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-fuse. 2024-09-13T18:02:13.315 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../055-ceph-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:13.362 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:13.378 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:02:13.397 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:13.437 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:13.765 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:02:13.781 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:02:13.823 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:02:13.840 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mds. 2024-09-13T18:02:13.857 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../056-ceph-mds_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:13.898 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:14.159 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:02:14.175 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:02:14.217 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:02:14.462 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephadm. 2024-09-13T18:02:14.478 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../057-cephadm_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:14.526 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:14.587 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:02:14.605 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:02:14.645 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:02:14.871 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-13T18:02:14.886 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../058-python3-asyncssh_1.12.2-1_all.deb ... 2024-09-13T18:02:14.941 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:02:14.960 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:02:14.961 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-09-13T18:02:14.999 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:02:15.340 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jinja2. 2024-09-13T18:02:15.356 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2ubuntu0.3_all.deb ... 2024-09-13T18:02:15.385 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:02:15.403 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:02:15.439 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:02:15.443 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:02:15.729 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:02:15.749 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:02:15.775 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-13T18:02:15.787 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:02:15.795 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:15.833 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:16.073 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:02:16.093 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:02:16.131 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:02:16.212 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-jwt. 2024-09-13T18:02:16.229 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-09-13T18:02:16.270 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:02:16.476 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:02:16.496 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:02:16.534 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:02:16.648 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-attr. 2024-09-13T18:02:16.665 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2024-09-13T18:02:16.706 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-09-13T18:02:16.787 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:02:16.803 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:02:16.837 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:02:17.097 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:02:17.109 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pluggy. 2024-09-13T18:02:17.114 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:02:17.128 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2024-09-13T18:02:17.155 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:02:17.167 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-09-13T18:02:17.508 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:02:17.521 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-py. 2024-09-13T18:02:17.526 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:02:17.538 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-09-13T18:02:17.566 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:02:17.596 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:02:17.886 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:02:17.903 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:17.944 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:17.949 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-atomicwrites. 2024-09-13T18:02:17.965 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-09-13T18:02:18.032 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:02:18.351 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-packaging. 2024-09-13T18:02:18.367 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2024-09-13T18:02:18.409 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-packaging (20.3-1) ... 2024-09-13T18:02:18.788 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pytest. 2024-09-13T18:02:18.805 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2024-09-13T18:02:18.845 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-09-13T18:02:19.233 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-13T18:02:19.249 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2024-09-13T18:02:19.290 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-13T18:02:19.332 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:02:19.352 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:02:19.390 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:02:19.585 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjs-underscore. 2024-09-13T18:02:19.604 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-09-13T18:02:19.685 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:02:19.744 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:02:19.759 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:02:19.801 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:02:19.996 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-09-13T18:02:20.013 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-09-13T18:02:20.054 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:02:20.104 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:02:20.122 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:02:20.162 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:02:20.432 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-routes. 2024-09-13T18:02:20.448 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2024-09-13T18:02:20.489 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-09-13T18:02:20.876 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-13T18:02:20.895 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:20.934 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:21.488 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:02:21.509 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:02:21.546 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:02:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:02:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:02:22.414 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-decorator. 2024-09-13T18:02:22.433 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-09-13T18:02:22.464 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:02:22.545 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:02:22.562 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:02:22.603 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:22.833 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-09-13T18:02:22.850 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-09-13T18:02:22.891 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:02:23.253 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-scipy. 2024-09-13T18:02:23.269 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-09-13T18:02:23.310 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-09-13T18:02:23.328 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:02:23.346 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:23.386 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:24.594 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:02:24.609 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:02:24.649 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:02:24.736 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-09-13T18:02:24.753 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-09-13T18:02:24.798 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:25.039 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:02:25.055 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:02:25.096 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:02:25.415 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-joblib. 2024-09-13T18:02:25.431 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2024-09-13T18:02:25.473 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-09-13T18:02:25.475 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:02:25.491 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:02:25.534 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:02:25.846 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:02:25.865 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:02:25.903 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:02:26.179 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-sklearn. 2024-09-13T18:02:26.199 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-09-13T18:02:26.216 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:02:26.234 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:02:26.243 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:26.274 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:02:26.619 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:02:26.635 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:02:26.677 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:02:26.974 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:02:26.991 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:02:27.010 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-13T18:02:27.027 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:27.032 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:02:27.068 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:27.362 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:02:27.379 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:02:27.419 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:02:27.733 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:02:27.752 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:02:27.780 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:02:28.077 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:02:28.093 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:02:28.135 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:02:28.204 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-cachetools. 2024-09-13T18:02:28.221 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2024-09-13T18:02:28.262 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-09-13T18:02:28.704 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-13T18:02:28.721 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-09-13T18:02:28.748 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:02:28.762 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:02:28.766 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:28.806 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:29.134 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:02:29.151 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:02:29.175 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-13T18:02:29.191 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-09-13T18:02:29.192 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:02:29.233 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:02:29.545 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:02:29.563 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:02:29.603 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:02:29.611 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-rsa. 2024-09-13T18:02:29.629 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2024-09-13T18:02:29.669 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-rsa (4.0-3) ... 2024-09-13T18:02:30.040 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-google-auth. 2024-09-13T18:02:30.056 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2024-09-13T18:02:30.098 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-09-13T18:02:30.109 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package jq. 2024-09-13T18:02:30.127 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:02:30.264 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:02:30.443 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-blinker. 2024-09-13T18:02:30.459 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-09-13T18:02:30.491 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package socat. 2024-09-13T18:02:30.507 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:02:30.526 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:02:30.549 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:02:30.858 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-oauthlib. 2024-09-13T18:02:30.874 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-09-13T18:02:30.895 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:02:30.911 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:02:30.916 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:02:30.953 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:02:31.290 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:02:31.307 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:31.311 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-13T18:02:31.329 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-09-13T18:02:31.348 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:31.370 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:02:31.732 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-websocket. 2024-09-13T18:02:31.748 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-09-13T18:02:31.790 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:02:32.178 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-13T18:02:32.195 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-09-13T18:02:32.236 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:02:32.882 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-13T18:02:32.901 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:32.940 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:33.277 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-13T18:02:33.296 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2024-09-13T18:02:33.359 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:02:33.721 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-13T18:02:33.740 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:02:33.804 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:02:34.099 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package jq. 2024-09-13T18:02:34.118 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:02:34.157 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:02:34.418 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package socat. 2024-09-13T18:02:34.435 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2024-09-13T18:02:34.497 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking socat (1.7.3.3-2) ... 2024-09-13T18:02:34.821 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package xmlstarlet. 2024-09-13T18:02:34.840 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-09-13T18:02:34.870 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:02:35.283 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-test. 2024-09-13T18:02:35.303 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../096-ceph-test_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:35.332 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:35.503 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:02:35.519 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:35.562 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:35.942 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:02:35.959 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:36.017 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:36.362 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:02:36.378 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:02:36.420 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:02:36.659 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:02:36.675 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:36.717 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:36.963 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:02:36.980 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:37.021 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:37.274 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:02:37.293 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:02:37.332 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:37.840 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:02:37.858 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:37.897 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:38.285 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:02:38.301 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:02:38.360 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:02:38.700 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:02:38.715 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:02:38.757 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:02:39.119 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:02:39.135 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:02:39.176 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:39.495 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ceph-volume. 2024-09-13T18:02:39.513 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../097-ceph-volume_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:39.587 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:39.977 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-13T18:02:39.996 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:40.068 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:40.429 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-colorama. 2024-09-13T18:02:40.446 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2024-09-13T18:02:40.487 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2024-09-13T18:02:40.801 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-shell. 2024-09-13T18:02:40.818 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../100-cephfs-shell_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:40.854 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:02:40.868 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:40.872 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:02:40.912 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:02:41.137 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package cephfs-top. 2024-09-13T18:02:41.156 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../101-cephfs-top_18.2.4-860-g6c6b083f-1focal_all.deb ... 2024-09-13T18:02:41.217 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:41.248 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:02:41.265 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:02:41.307 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:02:41.515 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package fonts-mathjax. 2024-09-13T18:02:41.533 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:02:41.573 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:41.585 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:02:41.605 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:02:41.643 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:02:42.005 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:02:42.025 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:02:42.063 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:02:42.181 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-13T18:02:42.200 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:42.239 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:42.527 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:02:42.547 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:02:42.588 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:02:42.700 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package nvme-cli. 2024-09-13T18:02:42.717 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.2_amd64.deb ... 2024-09-13T18:02:42.776 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:02:42.907 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:02:42.924 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:02:42.981 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:02:43.155 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-13T18:02:43.172 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-09-13T18:02:43.213 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:02:43.327 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:02:43.344 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:02:43.385 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:02:43.608 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libjs-mathjax. 2024-09-13T18:02:43.628 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-09-13T18:02:43.666 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:43.696 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:02:43.715 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:02:43.754 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:02:44.008 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:02:44.027 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:02:44.066 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:02:44.789 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:02:44.810 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:44.846 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:45.339 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python-natsort-doc. 2024-09-13T18:02:45.360 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2024-09-13T18:02:45.414 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-09-13T18:02:45.775 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-webencodings. 2024-09-13T18:02:45.791 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-09-13T18:02:45.866 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:02:46.203 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-html5lib. 2024-09-13T18:02:46.219 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2024-09-13T18:02:46.250 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:02:46.260 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-09-13T18:02:46.268 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:46.334 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:46.635 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:02:46.655 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-09-13T18:02:46.674 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-09-13T18:02:46.722 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:02:46.939 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:02:47.066 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:02:47.192 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:02:47.209 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pastescript. 2024-09-13T18:02:47.226 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2024-09-13T18:02:47.301 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-13T18:02:47.386 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:47.656 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-psutil. 2024-09-13T18:02:47.673 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-09-13T18:02:47.714 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:02:47.954 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user cephadm....done 2024-09-13T18:02:48.084 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-13T18:02:48.104 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-09-13T18:02:48.117 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:48.142 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:02:48.244 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:02:48.511 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package python3-simplejson. 2024-09-13T18:02:48.528 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-09-13T18:02:48.569 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:02:48.596 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:02:48.880 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:48.889 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-13T18:02:48.906 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-09-13T18:02:48.980 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:02:49.007 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:02:49.141 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:02:49.460 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:02:49.761 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package radosgw. 2024-09-13T18:02:49.778 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../116-radosgw_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:49.818 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:49.863 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:02:50.139 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:02:50.432 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:02:50.800 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:02:51.077 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:02:51.313 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package rbd-fuse. 2024-09-13T18:02:51.331 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../117-rbd-fuse_18.2.4-860-g6c6b083f-1focal_amd64.deb ... 2024-09-13T18:02:51.361 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:51.371 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:51.663 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:51.780 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:02:51.870 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-attr (19.3.0-2) ... 2024-09-13T18:02:52.073 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:02:52.160 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-09-13T18:02:52.311 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-09-13T18:02:52.375 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:02:52.437 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up nvme-cli (1.9-1ubuntu0.2) ... 2024-09-13T18:02:52.659 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:02:52.663 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:52.785 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:02:53.162 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:02:53.315 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user cephadm....done 2024-09-13T18:02:53.455 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:02:53.511 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:53.659 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-09-13T18:02:53.723 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:02:53.997 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-13T18:02:54.082 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:02:54.265 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-09-13T18:02:54.367 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:02:54.416 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-09-13T18:02:54.542 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-09-13T18:02:54.693 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:02:54.902 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-09-13T18:02:54.986 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:02:55.279 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:02:55.329 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-09-13T18:02:55.397 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:02:55.523 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:02:55.606 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-09-13T18:02:55.816 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:02:55.874 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2024-09-13T18:02:56.158 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-09-13T18:02:56.210 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:02:56.508 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-09-13T18:02:56.519 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:02:56.810 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-argparse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:56.879 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:02:57.223 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:02:57.369 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-09-13T18:02:57.374 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:02:57.495 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2024-09-13T18:02:57.684 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:02:57.819 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:02:57.838 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-09-13T18:02:58.115 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-09-13T18:02:58.154 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:02:58.280 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:02:58.391 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-09-13T18:02:58.406 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:02:58.550 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-09-13T18:02:58.716 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:02:58.935 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-09-13T18:02:59.034 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:02:59.160 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:02:59.278 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-09-13T18:02:59.311 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:02:59.546 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-09-13T18:02:59.630 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:02:59.889 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-09-13T18:02:59.906 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:03:00.191 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:03:00.223 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.3) ... 2024-09-13T18:03:00.325 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:03:00.549 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-09-13T18:03:00.602 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:03:00.900 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-packaging (20.3-1) ... 2024-09-13T18:03:01.212 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:03:01.218 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-09-13T18:03:01.365 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-09-13T18:03:01.495 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-09-13T18:03:01.513 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:03:01.796 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-09-13T18:03:01.924 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:03:02.182 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:03:02.198 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2024-09-13T18:03:02.309 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:03:02.491 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.2) ... 2024-09-13T18:03:02.644 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:03:02.884 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-09-13T18:03:02.987 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:03:03.088 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:03:03.214 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:03:03.278 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up socat (1.7.3.3-2) ... 2024-09-13T18:03:03.404 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:03.566 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:03:03.755 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:03:03.859 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:03:03.864 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-09-13T18:03:04.233 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-09-13T18:03:04.359 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-09-13T18:03:04.518 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-09-13T18:03:04.811 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-09-13T18:03:05.187 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:03:05.316 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-09-13T18:03:05.332 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:03:05.467 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:03:05.472 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-09-13T18:03:05.791 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-09-13T18:03:05.852 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:03:06.109 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-09-13T18:03:06.145 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:03:06.410 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-09-13T18:03:06.447 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:03:06.559 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-13T18:03:06.573 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:03:06.845 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-09-13T18:03:06.924 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:03:07.146 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-09-13T18:03:07.277 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:03:07.464 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-09-13T18:03:07.678 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:03:07.876 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-09-13T18:03:08.005 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:03:08.150 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-09-13T18:03:08.309 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-09-13T18:03:08.627 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-09-13T18:03:08.997 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-09-13T18:03:09.045 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:03:09.146 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:03:09.146 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-09-13T18:03:09.247 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:03:09.272 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webob (1:1.8.5-2ubuntu0.1) ... 2024-09-13T18:03:09.373 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:03:09.640 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-09-13T18:03:09.708 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:03:09.835 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:03:09.925 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-09-13T18:03:10.144 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:03:10.448 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:03:10.756 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:03:11.119 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:11.314 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:03:11.405 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:03:11.449 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:11.556 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-09-13T18:03:11.575 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:11.726 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:11.860 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:03:11.966 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-09-13T18:03:12.179 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:12.259 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-09-13T18:03:12.280 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:03:12.552 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-09-13T18:03:12.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:12.691 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:12.711 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-09-13T18:03:12.851 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:13.037 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-09-13T18:03:13.074 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:03:13.074 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:03:13.389 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-09-13T18:03:13.519 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:13.645 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:13.755 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:13.765 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-09-13T18:03:13.889 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:03:14.109 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-09-13T18:03:14.811 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:14.973 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:15.088 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:15.147 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-09-13T18:03:15.189 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:15.307 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-09-13T18:03:15.315 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:15.433 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-09-13T18:03:15.441 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:15.584 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rsa (4.0-3) ... 2024-09-13T18:03:15.868 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-09-13T18:03:15.978 INFO:teuthology.orchestra.run.smithi094.stdout:Adding group ceph....done 2024-09-13T18:03:16.044 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-09-13T18:03:16.346 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-09-13T18:03:16.381 INFO:teuthology.orchestra.run.smithi094.stdout:Adding system user ceph....done 2024-09-13T18:03:16.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting system user ceph properties....done 2024-09-13T18:03:16.589 INFO:teuthology.orchestra.run.smithi094.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:03:16.705 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-13T18:03:16.739 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:03:17.031 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-09-13T18:03:17.062 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:03:17.408 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librados2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:17.528 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:17.653 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-09-13T18:03:17.751 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:03:17.751 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:03:17.779 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librgw2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:17.930 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libsqlite3-mod-ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:18.056 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs2 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:18.188 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:18.207 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-routes (2.4.1-2) ... 2024-09-13T18:03:18.340 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:18.509 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libradosstriper1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:18.668 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-09-13T18:03:18.818 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:03:18.818 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:03:18.962 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up librbd1 (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:19.113 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-modules-core (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:19.238 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:19.258 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:19.498 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:03:19.498 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-13T18:03:19.673 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:03:19.957 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libcephfs-dev (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:20.108 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rados (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:20.118 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:20.259 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-top (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:20.357 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:03:20.357 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:03:20.376 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-09-13T18:03:20.812 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.045 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:03:21.045 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:03:21.332 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rbd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.483 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up rbd-fuse (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.489 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.609 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-rgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.768 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up python3-cephfs (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:21.928 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-shell (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:22.016 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:03:22.017 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:03:22.053 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-common (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:22.467 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:22.593 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:22.723 INFO:teuthology.orchestra.run.smithi088.stdout:Adding group ceph....done 2024-09-13T18:03:22.744 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:03:22.982 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:03:23.158 INFO:teuthology.orchestra.run.smithi088.stdout:Adding system user ceph....done 2024-09-13T18:03:23.292 INFO:teuthology.orchestra.run.smithi088.stdout:Setting system user ceph properties....done 2024-09-13T18:03:23.318 INFO:teuthology.orchestra.run.smithi088.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-13T18:03:23.421 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:23.470 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-13T18:03:23.564 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:23.690 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:23.805 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-13T18:03:23.833 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:24.228 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:03:24.297 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up cephfs-mirror (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:24.372 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:03:24.521 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:03:24.521 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:03:24.665 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:03:24.956 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-test (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:25.090 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up radosgw (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:25.542 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:03:25.542 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:03:25.984 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-base (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:26.395 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-13T18:03:26.828 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mds (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:27.075 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:03:27.075 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-13T18:03:27.504 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:27.601 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:03:27.748 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:03:27.748 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-13T18:03:28.216 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:03:28.219 DEBUG:teuthology.orchestra.run.smithi094:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:03:28.293 INFO:teuthology.orchestra.run.smithi094.stdout:Reading package lists... 2024-09-13T18:03:28.325 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-osd (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:28.514 INFO:teuthology.orchestra.run.smithi094.stdout:Building dependency tree... 2024-09-13T18:03:28.515 INFO:teuthology.orchestra.run.smithi094.stdout:Reading state information... 2024-09-13T18:03:28.728 INFO:teuthology.orchestra.run.smithi094.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:03:28.728 INFO:teuthology.orchestra.run.smithi094.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:03:28.728 INFO:teuthology.orchestra.run.smithi094.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:03:28.729 INFO:teuthology.orchestra.run.smithi094.stdout:The following additional packages will be installed: 2024-09-13T18:03:28.730 INFO:teuthology.orchestra.run.smithi094.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:03:28.730 INFO:teuthology.orchestra.run.smithi094.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:03:28.730 INFO:teuthology.orchestra.run.smithi094.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:03:28.730 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:03:28.730 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:03:28.732 INFO:teuthology.orchestra.run.smithi094.stdout:Suggested packages: 2024-09-13T18:03:28.732 INFO:teuthology.orchestra.run.smithi094.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:03:28.732 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:03:28.732 INFO:teuthology.orchestra.run.smithi094.stdout: libengine-pkcs11-openssl 2024-09-13T18:03:28.794 INFO:teuthology.orchestra.run.smithi094.stdout:The following NEW packages will be installed: 2024-09-13T18:03:28.794 INFO:teuthology.orchestra.run.smithi094.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:03:28.794 INFO:teuthology.orchestra.run.smithi094.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:03:28.795 INFO:teuthology.orchestra.run.smithi094.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:03:28.795 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:03:28.795 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:03:28.795 INFO:teuthology.orchestra.run.smithi094.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:03:28.795 INFO:teuthology.orchestra.run.smithi094.stdout:The following packages will be upgraded: 2024-09-13T18:03:28.796 INFO:teuthology.orchestra.run.smithi094.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:03:28.828 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:03:28.829 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-13T18:03:28.981 INFO:teuthology.orchestra.run.smithi094.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T18:03:28.981 INFO:teuthology.orchestra.run.smithi094.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:03:28.981 INFO:teuthology.orchestra.run.smithi094.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:03:28.981 INFO:teuthology.orchestra.run.smithi094.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:03:29.266 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-k8sevents (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:29.392 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-diskprediction-local (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:29.568 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mon (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:29.595 INFO:teuthology.orchestra.run.smithi094.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:03:29.596 INFO:teuthology.orchestra.run.smithi094.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:03:29.597 INFO:teuthology.orchestra.run.smithi094.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:03:29.610 INFO:teuthology.orchestra.run.smithi094.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:03:29.612 INFO:teuthology.orchestra.run.smithi094.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:03:29.710 INFO:teuthology.orchestra.run.smithi094.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:03:29.713 INFO:teuthology.orchestra.run.smithi094.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:03:29.720 INFO:teuthology.orchestra.run.smithi094.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:03:29.724 INFO:teuthology.orchestra.run.smithi094.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:03:29.724 INFO:teuthology.orchestra.run.smithi094.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:03:29.757 INFO:teuthology.orchestra.run.smithi094.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:03:29.759 INFO:teuthology.orchestra.run.smithi094.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:03:29.762 INFO:teuthology.orchestra.run.smithi094.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:03:29.763 INFO:teuthology.orchestra.run.smithi094.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:03:29.791 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:03:29.792 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-13T18:03:29.839 INFO:teuthology.orchestra.run.smithi094.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:03:29.839 INFO:teuthology.orchestra.run.smithi094.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:03:29.849 INFO:teuthology.orchestra.run.smithi094.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:03:29.851 INFO:teuthology.orchestra.run.smithi094.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:03:29.867 INFO:teuthology.orchestra.run.smithi094.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:03:29.867 INFO:teuthology.orchestra.run.smithi094.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:03:29.920 INFO:teuthology.orchestra.run.smithi094.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:03:29.920 INFO:teuthology.orchestra.run.smithi094.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:03:29.943 INFO:teuthology.orchestra.run.smithi094.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:03:29.971 INFO:teuthology.orchestra.run.smithi094.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:03:30.029 INFO:teuthology.orchestra.run.smithi094.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:03:30.039 INFO:teuthology.orchestra.run.smithi094.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:03:30.040 INFO:teuthology.orchestra.run.smithi094.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:03:30.040 INFO:teuthology.orchestra.run.smithi094.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:03:30.041 INFO:teuthology.orchestra.run.smithi094.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:03:30.066 INFO:teuthology.orchestra.run.smithi094.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:03:30.086 INFO:teuthology.orchestra.run.smithi094.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:03:30.219 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-cephadm (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:30.391 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:30.465 INFO:teuthology.orchestra.run.smithi094.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:03:30.465 INFO:teuthology.orchestra.run.smithi094.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:03:30.538 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-mgr-dashboard (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:30.545 INFO:teuthology.orchestra.run.smithi094.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:03:30.545 INFO:teuthology.orchestra.run.smithi094.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:03:30.546 INFO:teuthology.orchestra.run.smithi094.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:03:30.706 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ceph-volume (18.2.4-860-g6c6b083f-1focal) ... 2024-09-13T18:03:30.944 INFO:teuthology.orchestra.run.smithi094.stdout:Preconfiguring packages ... 2024-09-13T18:03:31.117 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:03:31.130 INFO:teuthology.orchestra.run.smithi094.stdout:Fetched 25.4 MB in 2s (14.6 MB/s) 2024-09-13T18:03:31.269 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:03:31.411 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:31.415 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:31.595 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:03:31.596 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:33.141 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:03:34.473 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-09-13T18:03:34.545 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:34.549 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:34.673 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:35.098 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:35.136 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:03:35.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-13T18:03:35.216 INFO:teuthology.orchestra.run.smithi088.stdout:Reading package lists... 2024-09-13T18:03:35.264 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:35.435 INFO:teuthology.orchestra.run.smithi088.stdout:Building dependency tree... 2024-09-13T18:03:35.436 INFO:teuthology.orchestra.run.smithi088.stdout:Reading state information... 2024-09-13T18:03:35.616 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:03:35.655 INFO:teuthology.orchestra.run.smithi088.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-09-13T18:03:35.655 INFO:teuthology.orchestra.run.smithi088.stdout:flex is already the newest version (2.6.4-6.2). 2024-09-13T18:03:35.655 INFO:teuthology.orchestra.run.smithi088.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2024-09-13T18:03:35.655 INFO:teuthology.orchestra.run.smithi088.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-09-13T18:03:35.656 INFO:teuthology.orchestra.run.smithi088.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-09-13T18:03:35.656 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages were automatically installed and are no longer required: 2024-09-13T18:03:35.656 INFO:teuthology.orchestra.run.smithi088.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-09-13T18:03:35.656 INFO:teuthology.orchestra.run.smithi088.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-13T18:03:35.657 INFO:teuthology.orchestra.run.smithi088.stdout:The following additional packages will be installed: 2024-09-13T18:03:35.657 INFO:teuthology.orchestra.run.smithi088.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2024-09-13T18:03:35.657 INFO:teuthology.orchestra.run.smithi088.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2024-09-13T18:03:35.658 INFO:teuthology.orchestra.run.smithi088.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2024-09-13T18:03:35.658 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2024-09-13T18:03:35.658 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch-data wpasupplicant 2024-09-13T18:03:35.659 INFO:teuthology.orchestra.run.smithi088.stdout:Suggested packages: 2024-09-13T18:03:35.659 INFO:teuthology.orchestra.run.smithi088.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2024-09-13T18:03:35.659 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2024-09-13T18:03:35.659 INFO:teuthology.orchestra.run.smithi088.stdout: libengine-pkcs11-openssl 2024-09-13T18:03:35.719 INFO:teuthology.orchestra.run.smithi088.stdout:The following NEW packages will be installed: 2024-09-13T18:03:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2024-09-13T18:03:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2024-09-13T18:03:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2024-09-13T18:03:35.720 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2024-09-13T18:03:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2024-09-13T18:03:35.721 INFO:teuthology.orchestra.run.smithi088.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-13T18:03:35.721 INFO:teuthology.orchestra.run.smithi088.stdout:The following packages will be upgraded: 2024-09-13T18:03:35.723 INFO:teuthology.orchestra.run.smithi088.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2024-09-13T18:03:35.907 INFO:teuthology.orchestra.run.smithi088.stdout:6 upgraded, 31 newly installed, 0 to remove and 289 not upgraded. 2024-09-13T18:03:35.908 INFO:teuthology.orchestra.run.smithi088.stdout:Need to get 25.4 MB of archives. 2024-09-13T18:03:35.908 INFO:teuthology.orchestra.run.smithi088.stdout:After this operation, 80.0 MB of additional disk space will be used. 2024-09-13T18:03:35.908 INFO:teuthology.orchestra.run.smithi088.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.6 [1,022 kB] 2024-09-13T18:03:36.085 INFO:teuthology.orchestra.run.smithi094.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:36.090 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:36.232 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:03:36.528 INFO:teuthology.orchestra.run.smithi088.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-09-13T18:03:36.530 INFO:teuthology.orchestra.run.smithi088.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-09-13T18:03:36.531 INFO:teuthology.orchestra.run.smithi088.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-09-13T18:03:36.544 INFO:teuthology.orchestra.run.smithi088.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-09-13T18:03:36.545 INFO:teuthology.orchestra.run.smithi088.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.23 [1,323 kB] 2024-09-13T18:03:36.643 INFO:teuthology.orchestra.run.smithi088.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2024-09-13T18:03:36.646 INFO:teuthology.orchestra.run.smithi088.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2024-09-13T18:03:36.653 INFO:teuthology.orchestra.run.smithi088.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2024-09-13T18:03:36.658 INFO:teuthology.orchestra.run.smithi088.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-09-13T18:03:36.658 INFO:teuthology.orchestra.run.smithi088.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.8 [60.6 kB] 2024-09-13T18:03:36.670 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:36.691 INFO:teuthology.orchestra.run.smithi088.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-09-13T18:03:36.693 INFO:teuthology.orchestra.run.smithi088.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2024-09-13T18:03:36.696 INFO:teuthology.orchestra.run.smithi088.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2024-09-13T18:03:36.697 INFO:teuthology.orchestra.run.smithi088.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2024-09-13T18:03:36.773 INFO:teuthology.orchestra.run.smithi088.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libndp0 amd64 1.7-0ubuntu1.1 [11.1 kB] 2024-09-13T18:03:36.773 INFO:teuthology.orchestra.run.smithi088.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.4 [370 kB] 2024-09-13T18:03:36.783 INFO:teuthology.orchestra.run.smithi088.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.20-0ubuntu0.20.04.1 [117 kB] 2024-09-13T18:03:36.786 INFO:teuthology.orchestra.run.smithi088.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2024-09-13T18:03:36.801 INFO:teuthology.orchestra.run.smithi088.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2024-09-13T18:03:36.801 INFO:teuthology.orchestra.run.smithi088.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.23 [1,586 kB] 2024-09-13T18:03:36.804 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:03:36.854 INFO:teuthology.orchestra.run.smithi088.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2024-09-13T18:03:36.855 INFO:teuthology.orchestra.run.smithi088.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2024-09-13T18:03:36.878 INFO:teuthology.orchestra.run.smithi088.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.4 [1,184 kB] 2024-09-13T18:03:36.905 INFO:teuthology.orchestra.run.smithi088.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.4 [1,854 kB] 2024-09-13T18:03:36.964 INFO:teuthology.orchestra.run.smithi088.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2024-09-13T18:03:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2024-09-13T18:03:36.972 INFO:teuthology.orchestra.run.smithi088.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2024-09-13T18:03:36.973 INFO:teuthology.orchestra.run.smithi088.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2024-09-13T18:03:36.973 INFO:teuthology.orchestra.run.smithi088.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.20-0ubuntu0.20.04.1 [1,055 kB] 2024-09-13T18:03:36.998 INFO:teuthology.orchestra.run.smithi088.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2024-09-13T18:03:37.020 INFO:teuthology.orchestra.run.smithi088.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.20-0ubuntu0.20.04.1 [13.5 MB] 2024-09-13T18:03:37.400 INFO:teuthology.orchestra.run.smithi088.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2024-09-13T18:03:37.400 INFO:teuthology.orchestra.run.smithi088.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2024-09-13T18:03:37.482 INFO:teuthology.orchestra.run.smithi088.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2024-09-13T18:03:37.482 INFO:teuthology.orchestra.run.smithi088.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2024-09-13T18:03:37.483 INFO:teuthology.orchestra.run.smithi088.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2024-09-13T18:03:37.572 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:03:37.896 INFO:teuthology.orchestra.run.smithi088.stdout:Preconfiguring packages ... 2024-09-13T18:03:38.004 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:03:38.111 INFO:teuthology.orchestra.run.smithi088.stdout:Fetched 25.4 MB in 2s (14.5 MB/s) 2024-09-13T18:03:38.500 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:03:38.520 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:03:38.558 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:03:38.674 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:38.679 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:38.862 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package dump. 2024-09-13T18:03:38.867 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking util-linux (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:38.880 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:03:38.912 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:03:39.199 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package indent. 2024-09-13T18:03:39.217 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:39.299 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:03:39.611 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:03:39.628 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:03:39.669 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:03:39.998 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:03:40.015 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:03:40.054 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up util-linux (2.34-0.1ubuntu9.6) ... 2024-09-13T18:03:40.057 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:03:40.335 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:03:40.353 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:40.426 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:03:40.763 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:03:40.781 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:40.822 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:03:41.100 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:03:41.117 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:41.158 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:03:41.511 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:03:41.517 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:41.522 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:41.529 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:41.569 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:03:41.680 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:41.923 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:03:41.941 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:03:41.981 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:03:42.162 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-09-13T18:03:42.310 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:03:42.331 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:03:42.361 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-09-13T18:03:42.368 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:03:42.721 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:03:42.730 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:03:42.748 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:42.788 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:43.215 INFO:teuthology.orchestra.run.smithi088.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153099 files and directories currently installed.) 2024-09-13T18:03:43.219 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:43.374 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:03:43.394 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:03:43.395 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:43.512 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:03:43.864 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:03:43.884 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:43.913 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:03:44.166 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:03:44.185 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:03:44.224 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:03:44.594 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:44.687 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:03:44.703 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:03:44.736 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:03:44.760 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-09-13T18:03:45.124 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:03:45.141 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:45.192 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:03:45.315 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:03:45.464 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.23) over (1.1.1f-1ubuntu2.16) ... 2024-09-13T18:03:45.789 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:03:45.806 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:03:45.872 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:03:45.985 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-13T18:03:46.002 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2024-09-13T18:03:46.043 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:03:46.412 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:03:46.429 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:03:46.446 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package dump. 2024-09-13T18:03:46.463 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2024-09-13T18:03:46.493 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:03:46.504 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking dump (0.4b46-6) ... 2024-09-13T18:03:46.841 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package indent. 2024-09-13T18:03:46.859 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:46.899 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:03:47.185 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-13T18:03:47.205 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2024-09-13T18:03:47.220 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package ppp. 2024-09-13T18:03:47.237 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:03:47.296 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:03:47.500 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:03:47.655 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-13T18:03:47.674 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.8_amd64.deb ... 2024-09-13T18:03:47.747 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:03:47.793 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:03:47.811 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:03:47.851 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:03:48.050 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-13T18:03:48.069 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-09-13T18:03:48.107 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:03:48.255 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:03:48.273 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:03:48.331 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:03:48.503 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-13T18:03:48.519 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:48.552 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:03:48.634 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:03:48.651 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:03:48.692 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:03:48.855 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-13T18:03:48.871 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:48.938 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:03:49.299 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-13T18:03:49.316 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:49.366 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:03:49.383 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:49.391 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:03:49.424 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:50.013 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:03:50.033 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:03:50.070 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-13T18:03:50.087 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1.1_amd64.deb ... 2024-09-13T18:03:50.095 INFO:teuthology.orchestra.run.smithi094.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:03:50.123 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:03:50.153 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:03:50.490 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-13T18:03:50.509 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:03:50.548 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:03:50.604 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:03:50.622 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:50.665 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:50.975 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-13T18:03:50.993 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../14-libpq5_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:51.036 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:51.412 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-13T18:03:51.430 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:51.462 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:03:51.831 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-13T18:03:51.852 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:51.889 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:03:52.150 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-13T18:03:52.169 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.23_amd64.deb ... 2024-09-13T18:03:52.208 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:03:52.326 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:03:52.345 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:03:52.384 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:03:52.645 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:03:52.663 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:03:52.703 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:03:52.837 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-13T18:03:52.854 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2024-09-13T18:03:52.895 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:03:52.948 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:03:52.965 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:03:53.006 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:03:53.233 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:03:53.250 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:03:53.289 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package modemmanager. 2024-09-13T18:03:53.292 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:03:53.307 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2024-09-13T18:03:53.350 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:03:53.696 INFO:teuthology.orchestra.run.smithi094.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:03:53.712 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:03:53.764 INFO:teuthology.orchestra.run.smithi094.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:03:54.062 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package wpasupplicant. 2024-09-13T18:03:54.065 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:03:54.081 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.4_amd64.deb ... 2024-09-13T18:03:54.154 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:03:54.277 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:03:54.554 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:54.680 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:03:54.750 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager. 2024-09-13T18:03:54.767 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.4_amd64.deb ... 2024-09-13T18:03:54.831 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:03:54.833 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:03:54.957 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:03:55.341 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:03:55.341 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:03:55.811 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:56.050 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package ppp. 2024-09-13T18:03:56.069 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2024-09-13T18:03:56.346 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:03:56.738 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:03:56.755 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package pptp-linux. 2024-09-13T18:03:56.772 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2024-09-13T18:03:56.813 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2024-09-13T18:03:56.819 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:03:56.936 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:03:57.096 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:03:57.233 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-13T18:03:57.250 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2024-09-13T18:03:57.309 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2024-09-13T18:03:57.662 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-13T18:03:57.681 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2024-09-13T18:03:57.719 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:03:58.049 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client-12. 2024-09-13T18:03:58.066 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../26-postgresql-client-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:58.130 INFO:teuthology.orchestra.run.smithi094.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:03:58.140 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:58.383 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:03:58.383 INFO:teuthology.orchestra.run.smithi094.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:03:58.629 INFO:teuthology.orchestra.run.smithi094.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:03:58.629 INFO:teuthology.orchestra.run.smithi094.stdout:Removing obsolete dictionary files: 2024-09-13T18:03:58.862 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-common. 2024-09-13T18:03:58.878 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2024-09-13T18:03:58.935 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:03:58.944 INFO:teuthology.orchestra.run.smithi088.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-13T18:03:58.971 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2024-09-13T18:03:59.476 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-12. 2024-09-13T18:03:59.494 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../28-postgresql-12_12.20-0ubuntu0.20.04.1_amd64.deb ... 2024-09-13T18:03:59.563 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:03:59.789 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:03:59.914 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:04:00.040 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:04:00.166 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:04:01.143 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:04:01.372 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:04:01.502 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:04:01.565 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:04:01.679 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql. 2024-09-13T18:04:01.691 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:04:01.696 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2024-09-13T18:04:01.754 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2024-09-13T18:04:01.817 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:04:01.943 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:04:02.031 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-client. 2024-09-13T18:04:02.051 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2024-09-13T18:04:02.089 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:04:02.119 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:04:02.245 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:04:02.350 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-13T18:04:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2024-09-13T18:04:02.441 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:04:02.602 INFO:teuthology.orchestra.run.smithi094.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:04:02.618 INFO:teuthology.orchestra.run.smithi094.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:04:02.669 INFO:teuthology.orchestra.run.smithi094.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:This user must also own the server process. 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:The default text search configuration will be set to "english". 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:Data page checksums are disabled. 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:02.670 INFO:teuthology.orchestra.run.smithi094.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:04:02.671 INFO:teuthology.orchestra.run.smithi094.stdout:creating subdirectories ... ok 2024-09-13T18:04:02.671 INFO:teuthology.orchestra.run.smithi094.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:04:02.687 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default max_connections ... 100 2024-09-13T18:04:02.710 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-13T18:04:02.712 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:04:02.727 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2024-09-13T18:04:02.728 INFO:teuthology.orchestra.run.smithi094.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:04:02.728 INFO:teuthology.orchestra.run.smithi094.stdout:creating configuration files ... ok 2024-09-13T18:04:02.777 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2024-09-13T18:04:02.840 INFO:teuthology.orchestra.run.smithi094.stdout:running bootstrap script ... ok 2024-09-13T18:04:03.222 INFO:teuthology.orchestra.run.smithi088.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-13T18:04:03.239 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2024-09-13T18:04:03.290 INFO:teuthology.orchestra.run.smithi088.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:04:03.367 INFO:teuthology.orchestra.run.smithi094.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:04:03.659 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2024-09-13T18:04:03.894 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:04:04.186 INFO:teuthology.orchestra.run.smithi094.stdout:syncing data to disk ... ok 2024-09-13T18:04:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:04.187 INFO:teuthology.orchestra.run.smithi094.stdout:Success. You can now start the database server using: 2024-09-13T18:04:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: pg_ctlcluster 12 main start 2024-09-13T18:04:04.187 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:04.229 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libpq5:amd64 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:04:04.388 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2024-09-13T18:04:04.491 INFO:teuthology.orchestra.run.smithi094.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:04:04.492 INFO:teuthology.orchestra.run.smithi094.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:04:04.539 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-09-13T18:04:04.569 INFO:teuthology.orchestra.run.smithi094.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:04:04.673 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.4) ... 2024-09-13T18:04:05.102 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:04:05.102 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-13T18:04:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:04:06.602 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-13T18:04:06.690 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-09-13T18:04:06.833 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2024-09-13T18:04:06.992 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2024-09-13T18:04:07.560 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:07.686 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:04:07.812 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:04:07.980 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:08.130 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:04:08.171 INFO:teuthology.orchestra.run.smithi088.stdout:Adding user postgres to group ssl-cert 2024-09-13T18:04:08.257 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:04:08.430 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:08.430 INFO:teuthology.orchestra.run.smithi088.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-13T18:04:08.677 INFO:teuthology.orchestra.run.smithi088.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-13T18:04:08.677 INFO:teuthology.orchestra.run.smithi088.stdout:Removing obsolete dictionary files: 2024-09-13T18:04:08.970 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout:- enp3s0f1 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:04:08.971 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:08.978 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-13T18:04:09.135 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:04:09.441 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:04:09.752 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.23) ... 2024-09-13T18:04:09.911 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2024-09-13T18:04:09.980 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:04:10.071 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.4) ... 2024-09-13T18:04:10.197 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2024-09-13T18:04:10.484 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:04:10.628 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:04:10.787 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:10.913 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:04:11.039 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:04:11.165 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:04:11.247 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2024-09-13T18:04:11.325 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:04:11.425 INFO:teuthology.orchestra.run.smithi094.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:04:11.513 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up dump (0.4b46-6) ... 2024-09-13T18:04:11.610 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-13T18:04:11.669 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:04:11.669 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:04:11.672 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:04:11.823 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.8) ... 2024-09-13T18:04:11.983 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2024-09-13T18:04:12.109 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2024-09-13T18:04:12.186 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:04:12.295 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:04:12.326 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1.1) ... 2024-09-13T18:04:12.446 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:04:12.486 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-12 (12.20-0ubuntu0.20.04.1) ... 2024-09-13T18:04:12.597 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:04:12.862 INFO:teuthology.orchestra.run.smithi088.stdout:Creating new PostgreSQL cluster 12/main ... 2024-09-13T18:04:12.879 INFO:teuthology.orchestra.run.smithi088.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2024-09-13T18:04:12.882 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:This user must also own the server process. 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:The database cluster will be initialized with locale "en_US". 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:The default text search configuration will be set to "english". 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:Data page checksums are disabled. 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:12.948 INFO:teuthology.orchestra.run.smithi088.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2024-09-13T18:04:12.949 INFO:teuthology.orchestra.run.smithi088.stdout:creating subdirectories ... ok 2024-09-13T18:04:12.949 INFO:teuthology.orchestra.run.smithi088.stdout:selecting dynamic shared memory implementation ... posix 2024-09-13T18:04:12.969 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default max_connections ... 100 2024-09-13T18:04:12.988 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default shared_buffers ... 128MB 2024-09-13T18:04:13.001 INFO:teuthology.orchestra.run.smithi088.stdout:selecting default time zone ... Etc/UTC 2024-09-13T18:04:13.002 INFO:teuthology.orchestra.run.smithi088.stdout:creating configuration files ... ok 2024-09-13T18:04:13.111 INFO:teuthology.orchestra.run.smithi088.stdout:running bootstrap script ... ok 2024-09-13T18:04:13.621 INFO:teuthology.orchestra.run.smithi088.stdout:performing post-bootstrap initialization ... ok 2024-09-13T18:04:14.419 INFO:teuthology.orchestra.run.smithi088.stdout:syncing data to disk ... ok 2024-09-13T18:04:14.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:14.419 INFO:teuthology.orchestra.run.smithi088.stdout:Success. You can now start the database server using: 2024-09-13T18:04:14.419 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:14.419 INFO:teuthology.orchestra.run.smithi088.stdout: pg_ctlcluster 12 main start 2024-09-13T18:04:14.420 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:14.736 INFO:teuthology.orchestra.run.smithi088.stdout:Ver Cluster Port Status Owner Data directory Log file 2024-09-13T18:04:14.736 INFO:teuthology.orchestra.run.smithi088.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2024-09-13T18:04:14.821 INFO:teuthology.orchestra.run.smithi088.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-13T18:04:17.900 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:18.051 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:04:18.186 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2024-09-13T18:04:18.379 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:18.538 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2024-09-13T18:04:18.664 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager (1.22.10-1ubuntu2.4) ... 2024-09-13T18:04:19.438 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:19.438 INFO:teuthology.orchestra.run.smithi088.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-13T18:04:19.438 INFO:teuthology.orchestra.run.smithi088.stdout:which means they are currently configured by ifupdown: 2024-09-13T18:04:19.438 INFO:teuthology.orchestra.run.smithi088.stdout:- enp3s0f1 2024-09-13T18:04:19.438 INFO:teuthology.orchestra.run.smithi088.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-13T18:04:19.439 INFO:teuthology.orchestra.run.smithi088.stdout:remove their configuration from /etc/network/interfaces. 2024-09-13T18:04:19.439 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:19.599 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-13T18:04:19.920 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-13T18:04:20.118 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:04:20.295 INFO:teuthology.orchestra.run.smithi094.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:04:20.454 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-13T18:04:20.942 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2024-09-13T18:04:21.104 INFO:teuthology.orchestra.run.smithi094.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:04:21.110 DEBUG:teuthology.parallel:result is None 2024-09-13T18:04:21.118 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2024-09-13T18:04:21.261 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-09-13T18:04:21.420 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2024-09-13T18:04:21.579 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2024-09-13T18:04:21.705 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:04:21.865 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2024-09-13T18:04:21.990 INFO:teuthology.orchestra.run.smithi088.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2024-09-13T18:04:22.307 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:04:22.307 INFO:teuthology.orchestra.run.smithi088.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-13T18:04:22.843 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2024-09-13T18:04:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-13T18:04:23.095 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-09-13T18:04:23.271 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-09-13T18:04:23.573 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-09-13T18:04:31.177 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2024-09-13T18:04:31.302 INFO:teuthology.orchestra.run.smithi088.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2024-09-13T18:04:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-13T18:04:32.467 DEBUG:teuthology.parallel:result is None 2024-09-13T18:04:32.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:32.616 DEBUG:teuthology.orchestra.run.smithi088:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:04:32.639 INFO:teuthology.orchestra.run.smithi088.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:04:32.640 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:04:32.640 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:04:32.642 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:04:32.784 DEBUG:teuthology.orchestra.run.smithi094:> dpkg-query -W -f '${Version}' ceph 2024-09-13T18:04:32.808 INFO:teuthology.orchestra.run.smithi094.stdout:18.2.4-860-g6c6b083f-1focal 2024-09-13T18:04:32.808 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860-g6c6b083f-1focal 2024-09-13T18:04:32.808 INFO:teuthology.task.install:The correct ceph version 18.2.4-860-g6c6b083f-1focal is installed. 2024-09-13T18:04:32.810 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:04:32.810 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:32.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:04:32.828 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:32.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:04:32.842 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:04:32.843 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:32.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:04:32.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:04:32.895 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:32.895 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:04:32.911 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:04:32.927 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:04:32.927 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:32.927 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:04:32.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:04:32.997 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:32.997 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:04:33.013 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:04:33.024 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:04:33.024 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:33.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:04:33.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:04:33.048 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:33.048 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:04:33.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:04:33.093 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:04:33.173 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:04:33.173 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2024-09-13T18:04:33.175 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-09-13T18:04:33.191 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:04:33.191 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:04:33.193 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:04:33.250 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:04:33.251 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:04:33.253 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:04:33.273 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:04:33.274 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:04:33.274 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:04:33.274 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:33.274 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:04:33.323 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:04:33.363 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:33.363 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:04:33.369 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:04:33.452 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:04:33.452 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:04:33.453 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7903951', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:04:33.453 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:04:33.456 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:04:33.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:04:33.465 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:04:33.483 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:33.483 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:04:33.528 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:04:33.528 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-09-13T18:04:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:04:33.535 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.535 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-09-13T18:04:33.535 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.535 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 17:59:54.791694205 +0000 2024-09-13T18:04:33.536 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 17:59:54.571699269 +0000 2024-09-13T18:04:33.536 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 17:59:54.571699269 +0000 2024-09-13T18:04:33.536 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-13T18:04:33.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:04:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T18:04:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T18:04:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000376942 s, 1.4 MB/s 2024-09-13T18:04:33.551 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:04:33.559 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 368 Links: 1 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 17:59:55.207684633 +0000 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 17:59:54.995689511 +0000 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 17:59:54.995689511 +0000 2024-09-13T18:04:33.564 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-13T18:04:33.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:04:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T18:04:33.577 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T18:04:33.578 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000362022 s, 1.4 MB/s 2024-09-13T18:04:33.578 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:04:33.632 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 373 Links: 1 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 17:59:55.651674415 +0000 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 17:59:55.431679478 +0000 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 17:59:55.431679478 +0000 2024-09-13T18:04:33.639 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-13T18:04:33.640 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:04:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T18:04:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T18:04:33.653 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000383595 s, 1.3 MB/s 2024-09-13T18:04:33.654 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:04:33.705 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-09-13T18:04:33.713 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:04:33.713 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.713 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-09-13T18:04:33.713 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.713 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-09-13 17:59:56.123663554 +0000 2024-09-13T18:04:33.714 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 17:59:55.891668892 +0000 2024-09-13T18:04:33.714 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 17:59:55.891668892 +0000 2024-09-13T18:04:33.714 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-13T18:04:33.714 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:04:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-09-13T18:04:33.728 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-09-13T18:04:33.729 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000352053 s, 1.5 MB/s 2024-09-13T18:04:33.729 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:04:33.778 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:33.779 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:33.779 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:04:33.786 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:04:33.786 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-09-13T18:04:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:04:33.793 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.793 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-09-13T18:04:33.793 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.794 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 17:59:50.605328733 +0000 2024-09-13T18:04:33.794 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 17:59:50.377333988 +0000 2024-09-13T18:04:33.794 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 17:59:50.377333988 +0000 2024-09-13T18:04:33.794 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-13T18:04:33.794 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:04:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T18:04:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T18:04:33.805 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000306911 s, 1.7 MB/s 2024-09-13T18:04:33.806 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:04:33.859 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-09-13T18:04:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:04:33.866 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 17:59:51.009319423 +0000 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 17:59:50.801324216 +0000 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 17:59:50.801324216 +0000 2024-09-13T18:04:33.867 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-13T18:04:33.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:04:33.881 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T18:04:33.881 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T18:04:33.881 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000233409 s, 2.2 MB/s 2024-09-13T18:04:33.882 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:04:33.889 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-09-13T18:04:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:04:33.937 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:33.937 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 370 Links: 1 2024-09-13T18:04:33.937 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:33.937 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 17:59:51.429309744 +0000 2024-09-13T18:04:33.938 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 17:59:51.205314906 +0000 2024-09-13T18:04:33.938 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 17:59:51.205314906 +0000 2024-09-13T18:04:33.938 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-13T18:04:33.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:04:33.953 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T18:04:33.953 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T18:04:33.953 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000289269 s, 1.8 MB/s 2024-09-13T18:04:33.954 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:04:33.962 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-09-13 17:59:51.833300434 +0000 2024-09-13T18:04:34.013 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-09-13 17:59:51.621305319 +0000 2024-09-13T18:04:34.014 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-09-13 17:59:51.621305319 +0000 2024-09-13T18:04:34.014 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: - 2024-09-13T18:04:34.014 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:04:34.029 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-09-13T18:04:34.029 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-09-13T18:04:34.029 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000288218 s, 1.8 MB/s 2024-09-13T18:04:34.030 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:04:34.040 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:34.040 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:04:34.040 INFO:tasks.ceph:Generating config... 2024-09-13T18:04:34.041 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:04:34.041 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-09-13T18:04:34.042 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:04:34.042 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:04:34.042 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:04:34.042 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:04:34.042 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:04:34.043 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:04:34.044 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:04:34.044 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:04:34.044 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:04:34.044 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-13T18:04:34.045 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:04:34.045 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:04:34.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:04:34.086 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:04:34.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:04:34.146 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:04:34.205 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]')] 2024-09-13T18:04:34.205 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:04:34.206 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:34.206 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:04:34.211 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:34.256 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:34.256 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid 70755675-8bb0-445c-8ac9-8148c6ab712e 2024-09-13T18:04:34.256 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:fsid 70755675-8bb0-445c-8ac9-8148c6ab712e 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2024-09-13T18:04:34.255927+0000 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:created 2024-09-13T18:04:34.255927+0000 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-09-13T18:04:34.257 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:04:34.258 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:04:34.263 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 70755675-8bb0-445c-8ac9-8148c6ab712e... 2024-09-13T18:04:34.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:04:34.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.336 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2024-09-13T18:04:34.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.338 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 70755675-8bb0-445c-8ac9-8148c6ab712e 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2024-09-13T18:04:34.339 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:04:34.340 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2024-09-13T18:04:34.341 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2024-09-13T18:04:34.342 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2024-09-13T18:04:34.342 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore compression mode = aggressive 2024-09-13T18:04:34.342 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2024-09-13T18:04:34.342 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: osd blocked scrub grace period = 3600 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: osd max markdown count = 1000 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.343 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2024-09-13T18:04:34.344 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.345 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on pool no app = False 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2024-09-13T18:04:34.346 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: client_shutdown_timeout = 120 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.e] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-09-13T18:04:34.347 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.f] 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal fragment size max = 10000 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal merge size = 5 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split bits = 3 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds bal split size = 100 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds oft prefetch dirfrags = True 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2024-09-13T18:04:34.348 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2024-09-13T18:04:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: mds_dir_prefetch = True 2024-09-13T18:04:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T18:04:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2024-09-13T18:04:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2024-09-13T18:04:34.349 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-09-13T18:04:34.350 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.351 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-09-13T18:04:34.352 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.88,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 70755675-8bb0-445c-8ac9-8148c6ab712e 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-09-13T18:04:34.353 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.354 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore compression mode = aggressive 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 20 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 20 2024-09-13T18:04:34.355 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 10 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: osd blocked scrub grace period = 3600 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: osd max markdown count = 1000 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-09-13T18:04:34.356 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-09-13T18:04:34.357 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.358 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on pool no app = False 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: client_shutdown_timeout = 120 2024-09-13T18:04:34.359 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-09-13T18:04:34.360 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal fragment size max = 10000 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal merge size = 5 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split bits = 3 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds bal split size = 100 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds oft prefetch dirfrags = True 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds_dir_prefetch = True 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: mds_sleep_rank_change = 5000000.0 2024-09-13T18:04:34.361 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-09-13T18:04:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-09-13T18:04:34.362 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-09-13T18:04:34.363 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:04:34.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:04:34.415 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:04:34.415 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:34.415 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:04:34.422 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:34.422 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:04:34.427 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:04:34.427 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:34.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:04:34.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:04:34.448 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:04:34.448 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:34.454 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:04:34.454 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:34.454 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:04:34.454 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:04:34.480 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:04:34.480 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:34.528 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:04:34.528 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:04:34.529 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:04:34.578 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:04:34.581 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:04:34.631 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:04:34.649 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:04:34.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:04:34.697 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:04:34.700 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:04:34.712 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:04:34.759 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:04:34.762 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:04:34.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T18:04:34.820 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-09-13T18:04:34.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-09-13T18:04:34.833 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:04:34.884 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:04:34.887 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:04:34.897 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:04:34.939 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:04:34.942 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:04:34.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T18:04:35.039 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-09-13T18:04:35.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-09-13T18:04:35.055 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:04:35.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:04:35.098 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:04:35.111 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:04:35.111 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:04:35.111 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:04:35.169 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:35.169 INFO:tasks.ceph:role: osd.0 2024-09-13T18:04:35.169 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:04:35.169 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:04:35.692 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:35.693 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:35.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-09-13T18:04:35.694 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:04:35.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:04:35.791 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:35.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:35.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:04:35.847 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:35.848 INFO:tasks.ceph:role: osd.1 2024-09-13T18:04:35.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:04:35.848 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:04:36.361 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:36.362 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:36.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-09-13T18:04:36.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:04:36.400 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:04:36.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:36.412 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:36.412 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:04:36.422 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:36.422 INFO:tasks.ceph:role: osd.2 2024-09-13T18:04:36.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:04:36.423 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:04:36.884 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:36.885 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:36.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-09-13T18:04:36.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:04:36.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:04:36.952 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:36.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:36.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:04:36.964 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:36.964 INFO:tasks.ceph:role: osd.3 2024-09-13T18:04:36.965 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:04:36.965 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:37.486 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:37.488 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2024-09-13T18:04:37.488 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:04:37.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:04:37.561 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:37.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:37.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:37.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.646+0000 7f247010b880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:04:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.650+0000 7f247010b880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:04:37.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.650+0000 7f247010b880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:04:37.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.650+0000 7f247010b880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:04:37.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.650+0000 7f247010b880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-09-13T18:04:37.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:37.650+0000 7f247010b880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-13T18:04:40.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:04:40.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:40.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:04:40.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:04:40.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:04:40.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:04:40.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-09-13T18:04:40.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:40.770+0000 7f8aa67f3880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-13T18:04:43.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:04:43.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.821+0000 7f761887c880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:04:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.821+0000 7f761887c880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:04:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.821+0000 7f761887c880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:04:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.821+0000 7f761887c880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:04:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.825+0000 7f761887c880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-09-13T18:04:43.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:43.825+0000 7f761887c880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-13T18:04:46.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:04:46.890 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:46.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:04:46.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:04:46.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:04:46.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:04:46.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-09-13T18:04:46.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:04:46.929+0000 7f6c35032880 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-13T18:04:49.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:04:49.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:04:49.946 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:49.946 INFO:tasks.ceph:role: osd.4 2024-09-13T18:04:49.947 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:04:49.947 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:50.034 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:50.035 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:50.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-13T18:04:50.036 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:04:50.053 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:04:50.061 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:50.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:50.062 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:04:50.074 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:50.074 INFO:tasks.ceph:role: osd.5 2024-09-13T18:04:50.074 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:04:50.075 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:04:50.161 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:50.161 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:50.161 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:50.161 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:50.162 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:50.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-13T18:04:50.163 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:04:50.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:04:50.190 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:50.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:50.191 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:04:50.202 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:50.202 INFO:tasks.ceph:role: osd.6 2024-09-13T18:04:50.202 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:04:50.202 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:04:50.242 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:50.242 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:50.243 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:50.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-13T18:04:50.244 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:04:50.306 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:04:50.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:50.314 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:50.315 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:04:50.326 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:04:50.327 INFO:tasks.ceph:role: osd.7 2024-09-13T18:04:50.327 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:04:50.327 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:04:50.413 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:04:50.414 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:04:50.415 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-09-13T18:04:50.415 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:04:50.432 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:04:50.440 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:04:50.440 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: /sbin/restorecon: command not found 2024-09-13T18:04:50.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:50.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.551+0000 7f9db67fa880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:04:50.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.551+0000 7f9db67fa880 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:04:50.562 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.551+0000 7f9db67fa880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:04:50.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.551+0000 7f9db67fa880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:04:50.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.551+0000 7f9db67fa880 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-09-13T18:04:50.563 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:50.555+0000 7f9db67fa880 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-13T18:04:53.566 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:04:53.584 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:53.630 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.619+0000 7f38b3b0e880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:04:53.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.619+0000 7f38b3b0e880 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:04:53.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.619+0000 7f38b3b0e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:04:53.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.623+0000 7f38b3b0e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:04:53.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.623+0000 7f38b3b0e880 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-09-13T18:04:53.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:53.623+0000 7f38b3b0e880 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-13T18:04:56.608 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:04:56.624 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:56.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:04:56.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:04:56.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:04:56.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:04:56.667 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-09-13T18:04:56.668 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:56.660+0000 7f9435c43880 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-13T18:04:59.644 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:04:59.659 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:04:59.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:04:59.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:04:59.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:04:59.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:04:59.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-09-13T18:04:59.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:04:59.696+0000 7f5537b61880 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-13T18:05:02.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:05:02.715 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:05:02.716 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:05:02.733 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:05:02.744 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:05:02.759 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.760 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-09-13T18:05:02.818 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:05:02.833 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:05:02.843 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.843 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:05:02.901 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:02.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:05:02.913 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:02.913 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:05:02.928 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:02.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:05:02.938 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:02.938 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:05:02.953 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:02.953 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-09-13T18:05:02.964 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:02.964 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:05:03.017 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:03.017 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:05:03.027 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:03.027 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:05:03.041 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:03.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:05:03.051 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:03.052 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:05:03.058 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:05:03.059 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:05:03.103 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmo+pxIhAASwMvJgldNd15k9WXaY64Kw== 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmPDKQKRAAN+6TY7pLJTeWZqpTh2YJmQ== 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmczRALRAAtT53So+fiEE6k0Q0NGo6ag== 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.e] 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmdmPfMBAATepkp1DyEiaHroArF0rs5g== 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC1fuRmRC64JhAA+TmoxhijiEjc+2g6OvL2Hw== 2024-09-13T18:05:03.116 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC4fuRmXqQPLhAATwRPoqhn/oZ7HIQ1UEbK0w== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC7fuRmHUs2MRAABrMkK0WnKSIY0iKWcVd4Hg== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQC+fuRmha6ANxAAgWwxbPAoYnrjBzjuFD+FlQ== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmjX1aJRAA3dB/+Yu+/dnugHOxrX1lnA== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmDH5jNBAAFznnu91IZ6vEejfEjIks1g== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCyfuRmvkeuNxAAwak+TOacjwOkLJsbc9kGQQ== 2024-09-13T18:05:03.117 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.f] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCzfuRmmZcTAhAAFW6oWDdSaRRnMgd0vFJhrg== 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDCfuRmF6AwIRAAO9IclyrpyrDkj4t3nJtoZg== 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDFfuRmEidGJRAAPBWphBF9hNeWMbIWsWTKhg== 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDIfuRmr9l2JxAAoX4BbYOuCdRJ5rAmakbNiA== 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDLfuRmuGWpKRAAkWmzD8sUqpY7NWR63nYpcA== 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-09-13T18:05:03.118 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQCzfuRmR3vTBRAAlSaTs8ptG3f7vmAk9cOpHA== 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmo+pxIhAASwMvJgldNd15k9WXaY64Kw== 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmPDKQKRAAN+6TY7pLJTeWZqpTh2YJmQ== 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmczRALRAAtT53So+fiEE6k0Q0NGo6ag== 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.e] 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmdmPfMBAATepkp1DyEiaHroArF0rs5g== 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-09-13T18:05:03.120 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC1fuRmRC64JhAA+TmoxhijiEjc+2g6OvL2Hw== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC4fuRmXqQPLhAATwRPoqhn/oZ7HIQ1UEbK0w== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC7fuRmHUs2MRAABrMkK0WnKSIY0iKWcVd4Hg== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQC+fuRmha6ANxAAgWwxbPAoYnrjBzjuFD+FlQ== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmjX1aJRAA3dB/+Yu+/dnugHOxrX1lnA== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmDH5jNBAAFznnu91IZ6vEejfEjIks1g== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCyfuRmvkeuNxAAwak+TOacjwOkLJsbc9kGQQ== 2024-09-13T18:05:03.121 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.f] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCzfuRmmZcTAhAAFW6oWDdSaRRnMgd0vFJhrg== 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDCfuRmF6AwIRAAO9IclyrpyrDkj4t3nJtoZg== 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDFfuRmEidGJRAAPBWphBF9hNeWMbIWsWTKhg== 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDIfuRmr9l2JxAAoX4BbYOuCdRJ5rAmakbNiA== 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQDLfuRmuGWpKRAAkWmzD8sUqpY7NWR63nYpcA== 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-09-13T18:05:03.122 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQCzfuRmR3vTBRAAlSaTs8ptG3f7vmAk9cOpHA== 2024-09-13T18:05:03.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:05:03.125 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:05:03.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.213 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.265 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.267 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.320 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.323 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.374 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.377 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.423 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.425 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.454 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:05:03.457 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:05:03.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.516 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.570 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.620 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:05:03.623 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:05:03.671 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.728 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.731 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.782 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:05:03.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.880 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.930 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:03.984 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:04.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:04.034 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:05:04.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:05:04.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:05:04.132 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:05:04.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:05:04.185 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:05:04.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:05:04.281 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:05:04.298 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:05:04.383 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:05:04.399 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:05:04.413 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:05:04.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:05:04.512 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:05:04.515 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:05:04.519 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:05:04.520 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:05:04.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:05:04.564 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:05:04.564 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:05:04.564 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:05:04.566 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:05:04.566 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:05:04.566 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:05:04.568 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:05:04.569 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:05:04.569 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:05:04.569 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:05:04.571 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:05:04.571 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:05:04.571 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:05:04.574 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:05:04.574 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:05:04.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:05:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 Processor -- start 2024-09-13T18:05:04.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 -- start start 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c06c270 con 0x7f065c0b1130 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0706c0 con 0x7f065c156330 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.673+0000 7f0662a07700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c150440 con 0x7f065c150060 2024-09-13T18:05:04.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661204700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f065c0b1130 0x7f065c155c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:51744/0 (socket says 172.21.15.88:51744) 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 learned_addr learned my addr 172.21.15.88:0/87744220 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:04.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:04.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.677+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:05:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:04.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:05:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:05:04.884 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:04.881+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:05:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:05:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:05.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:05:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:05:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:05.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:05.285+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:05:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:05:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0661a05700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:05:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:06.089+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.673+0000 7f06537fe700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 msgr2=0x7f065c06d770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.673+0000 7f06537fe700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f065c150060 0x7f065c06d770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 msgr2=0x7f065c06dcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.88:3300/0 conn(0x7f065c156330 0x7f065c06dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 -- 172.21.15.88:0/87744220 >> v1:172.21.15.88:6789/0 conn(0x7f065c0b1130 legacy=0x7f065c155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:07.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 -- 172.21.15.88:0/87744220 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c070420 con 0x7f0640003740 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f06537fe700 1 -- 172.21.15.88:0/87744220 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0706c0 con 0x7f0640007460 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:07.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.677+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.881+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.881+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:05:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.881+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.881+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:07.883 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:07.881+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:05:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:08.285+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:08.285+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:05:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:08.285+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:08.285+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:08.285+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:05:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.089+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.089+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:05:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.089+0000 7f0661204700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:05:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.089+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:05:09.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.089+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361884603 0 0) 0x7f065c070420 con 0x7f0640003740 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06480035d0 con 0x7f0640003740 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3353221870 0 0) 0x7f06480035d0 con 0x7f0640003740 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 msgr2=0x7f0640009900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 --2- 172.21.15.88:0/87744220 >> v2:172.21.15.94:3300/0 conn(0x7f0640007460 0x7f0640009900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064000b060 con 0x7f0640003740 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f065800c570 con 0x7f0640003740 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 >> v1:172.21.15.94:6789/0 conn(0x7f0640003740 legacy=0x7f0640005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 reap_dead start 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648003a70 0x7f0648003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 0x7f0648004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 0x7f064800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0706c0 con 0x7f0648004870 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064800c2f0 con 0x7f0648005430 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064800c4b0 con 0x7f0648003a70 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 0x7f0648004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 0x7f064800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.761+0000 7f0661a05700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648003a70 0x7f0648003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648003a70 msgr2=0x7f0648003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648003a70 0x7f0648003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 msgr2=0x7f0648004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 0x7f0648004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 -- 172.21.15.88:0/87744220 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480035d0 con 0x7f0648005430 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0661204700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 0x7f0648004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0662206700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 0x7f064800ba30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0640009ec0 tx=0x7f06480058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc8d1ca536795e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654003d20 con 0x7f0648005430 2024-09-13T18:05:09.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0654004100 con 0x7f0648005430 2024-09-13T18:05:09.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.765+0000 7f0660a03700 1 -- 172.21.15.88:0/87744220 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654004490 con 0x7f0648005430 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 -- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 msgr2=0x7f064800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 0x7f064800ba30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0640009ec0 tx=0x7f06480058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 -- 172.21.15.88:0/87744220 shutdown_connections 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648005430 0x7f064800ba30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648004870 0x7f0648004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 --2- 172.21.15.88:0/87744220 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648003a70 0x7f0648003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 -- 172.21.15.88:0/87744220 >> 172.21.15.88:0/87744220 conn(0x7f065c0c7a40 msgr2=0x7f065c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 -- 172.21.15.88:0/87744220 shutdown_connections 2024-09-13T18:05:09.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.769+0000 7f0662a07700 1 -- 172.21.15.88:0/87744220 wait complete. 2024-09-13T18:05:09.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 Processor -- start 2024-09-13T18:05:09.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 -- start start 2024-09-13T18:05:09.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648004870 0x7f065c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648005430 0x7f065c0c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1ebf00 con 0x7f0648003a70 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1ee650 con 0x7f0648004870 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662a07700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1ee930 con 0x7f0648005430 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0661a05700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0661204700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648004870 0x7f065c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0661a05700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60896/0 (socket says 172.21.15.88:60896) 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0661a05700 1 -- 172.21.15.88:0/1768246594 learned_addr learned my addr 172.21.15.88:0/1768246594 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.773+0000 7f0662206700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648005430 0x7f065c0c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 -- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648005430 msgr2=0x7f065c0c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:09.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648005430 0x7f065c0c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 -- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648004870 msgr2=0x7f065c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648004870 0x7f065c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 -- 172.21.15.88:0/1768246594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c1eec10 con 0x7f0648003a70 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0661a05700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0658018ce0 tx=0x7f06580142f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658014cb0 con 0x7f0648003a70 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f065800c040 con 0x7f0648003a70 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c1eeef0 con 0x7f0648003a70 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658023690 con 0x7f0648003a70 2024-09-13T18:05:09.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c1572d0 con 0x7f0648003a70 2024-09-13T18:05:09.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f0658023af0 con 0x7f0648003a70 2024-09-13T18:05:09.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.777+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0658000e40 con 0x7f0648003a70 2024-09-13T18:05:09.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.781+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c06c270 con 0x7f0648003a70 2024-09-13T18:05:09.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.785+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f065c06c270 con 0x7f0648003a70 2024-09-13T18:05:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.857+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f065c14b990 con 0x7f0648003a70 2024-09-13T18:05:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f06527fc700 1 -- 172.21.15.88:0/1768246594 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f065800f040 con 0x7f0648003a70 2024-09-13T18:05:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 msgr2=0x7f065c0b0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0658018ce0 tx=0x7f06580142f0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 shutdown_connections 2024-09-13T18:05:09.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0648005430 0x7f065c0c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0648004870 0x7f065c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 --2- 172.21.15.88:0/1768246594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0648003a70 0x7f065c0b0840 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.861+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 >> 172.21.15.88:0/1768246594 conn(0x7f065c0c7a40 msgr2=0x7f065c14bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.865+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 shutdown_connections 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:09.865+0000 7f0662a07700 1 -- 172.21.15.88:0/1768246594 wait complete. 2024-09-13T18:05:09.867 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-09-13T18:05:09.884 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:05:09.884 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:05:09.884 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:09.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:05:09.894 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:09.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:05:09.904 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:09.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:05:09.919 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:05:09.919 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:05:09.932 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:09.932 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:05:09.948 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:09.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:05:09.969 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:09.965+0000 7f2f9e82f2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:05:09.981 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:09.982 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:05:10.040 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-09-13T18:05:10.040 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:05:10.048 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 7642ce31-b465-4ddc-941a-5f9e2cd29ea5 0 2024-09-13T18:05:10.157 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 Processor -- start 2024-09-13T18:05:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- start start 2024-09-13T18:05:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd68814dc20 0x7fd6880c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.158 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880710e0 con 0x7fd6880c28a0 2024-09-13T18:05:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6880701c0 con 0x7fd68814d840 2024-09-13T18:05:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd688158490 con 0x7fd68814dc20 2024-09-13T18:05:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd687fff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fd68814d840 0x7fd6880c7720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58526/0 (socket says 172.21.15.94:58526) 2024-09-13T18:05:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd687fff700 1 -- 172.21.15.94:0/3540331126 learned_addr learned my addr 172.21.15.94:0/3540331126 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-13T18:05:10.159 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68cb98700 1 --2- 172.21.15.94:0/3540331126 >> v2:172.21.15.94:3300/0 conn(0x7fd68814dc20 0x7fd6880c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd686ffd700 1 -- 172.21.15.94:0/3540331126 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443842985 0 0) 0x7fd680001490 con 0x7fd68814d840 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd686ffd700 1 -- 172.21.15.94:0/3540331126 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6700035d0 con 0x7fd68814d840 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68cb98700 1 -- 172.21.15.94:0/3540331126 >> v1:172.21.15.94:6789/0 conn(0x7fd68814d840 legacy=0x7fd6880c7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68cb98700 1 -- 172.21.15.94:0/3540331126 >> v1:172.21.15.88:6789/0 conn(0x7fd6880c28a0 legacy=0x7fd6880c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68cb98700 1 -- 172.21.15.94:0/3540331126 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880708a0 con 0x7fd68814dc20 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68cb98700 1 --2- 172.21.15.94:0/3540331126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6880c8d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd68806f3d0 tx=0x7fd678009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2525ba590f1dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd686ffd700 1 -- 172.21.15.94:0/3540331126 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004020 con 0x7fd68814dc20 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd686ffd700 1 -- 172.21.15.94:0/3540331126 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678004180 con 0x7fd68814dc20 2024-09-13T18:05:10.160 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd686ffd700 1 -- 172.21.15.94:0/3540331126 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004530 con 0x7fd68814dc20 2024-09-13T18:05:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- 172.21.15.94:0/3540331126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 msgr2=0x7fd6880c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.161 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/3540331126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6880c8d40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd68806f3d0 tx=0x7fd678009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- 172.21.15.94:0/3540331126 shutdown_connections 2024-09-13T18:05:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/3540331126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6880c8d40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- 172.21.15.94:0/3540331126 >> 172.21.15.94:0/3540331126 conn(0x7fd68806a400 msgr2=0x7fd68806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- 172.21.15.94:0/3540331126 shutdown_connections 2024-09-13T18:05:10.162 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.153+0000 7fd68e5fb700 1 -- 172.21.15.94:0/3540331126 wait complete. 2024-09-13T18:05:10.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 Processor -- start 2024-09-13T18:05:10.163 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 -- start start 2024-09-13T18:05:10.165 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 0x7fd6880c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 0x7fd688147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68814cff0 con 0x7fd68814d840 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c2da0 con 0x7fd68814dc20 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68e5fb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6880c3510 con 0x7fd6880c28a0 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd687fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 0x7fd6880c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd687fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 0x7fd6880c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43208/0 (socket says 172.21.15.94:43208) 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd687fff700 1 -- 172.21.15.94:0/152623627 learned_addr learned my addr 172.21.15.94:0/152623627 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38574/0 (socket says 172.21.15.94:38574) 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd6877fe700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 0x7fd688147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 -- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 msgr2=0x7fd6880c4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 0x7fd6880c4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.166 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 -- 172.21.15.94:0/152623627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 msgr2=0x7fd688147510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 0x7fd688147510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 -- 172.21.15.94:0/152623627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780094b0 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd6877fe700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 0x7fd688147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.157+0000 7fd68cb98700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd678015000 tx=0x7fd678004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780045f0 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678011d20 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68814cd30 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780038e0 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6881467c0 con 0x7fd68814dc20 2024-09-13T18:05:10.167 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd678003d40 con 0x7fd68814dc20 2024-09-13T18:05:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd67801a440 con 0x7fd68814dc20 2024-09-13T18:05:10.168 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.161+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6880c7200 con 0x7fd68814dc20 2024-09-13T18:05:10.169 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.165+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd678015030 con 0x7fd68814dc20 2024-09-13T18:05:10.244 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.237+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7642ce31-b465-4ddc-941a-5f9e2cd29ea5", "id": 0} v 0) v1 -- 0x7fd6880c65f0 con 0x7fd68814dc20 2024-09-13T18:05:10.251 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd684ff9700 1 -- 172.21.15.94:0/152623627 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7642ce31-b465-4ddc-941a-5f9e2cd29ea5", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd67802d440 con 0x7fd68814dc20 2024-09-13T18:05:10.251 INFO:teuthology.orchestra.run.smithi094.stdout:0 2024-09-13T18:05:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 msgr2=0x7fd6881f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd678015000 tx=0x7fd678004770 comp rx=0 tx=0).stop 2024-09-13T18:05:10.252 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 shutdown_connections 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68814dc20 0x7fd6881f20b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68814d840 0x7fd688147510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 --2- 172.21.15.94:0/152623627 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd6880c28a0 0x7fd6880c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 >> 172.21.15.94:0/152623627 conn(0x7fd68806a400 msgr2=0x7fd6880c9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 shutdown_connections 2024-09-13T18:05:10.253 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.245+0000 7fd68e5fb700 1 -- 172.21.15.94:0/152623627 wait complete. 2024-09-13T18:05:10.269 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new f91b2977-4a3d-45c1-82e1-acf5ea0406dc 1 2024-09-13T18:05:10.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.381+0000 7ff9dfa24700 1 Processor -- start 2024-09-13T18:05:10.388 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.381+0000 7ff9dfa24700 1 -- start start 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 0x7ff9d8157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80c01b0 con 0x7ff9d8066570 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d80c0450 con 0x7ff9d80c70c0 2024-09-13T18:05:10.390 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c0730 con 0x7ff9d80c74a0 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dd7c0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dd7c0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38584/0 (socket says 172.21.15.94:38584) 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43222/0 (socket says 172.21.15.94:43222) 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dd7c0700 1 -- 172.21.15.94:0/774006868 learned_addr learned my addr 172.21.15.94:0/774006868 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9ddfc1700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 0x7ff9d8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 -- 172.21.15.94:0/774006868 >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 msgr2=0x7ff9d815dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 -- 172.21.15.94:0/774006868 >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 msgr2=0x7ff9d8157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 0x7ff9d8157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 -- 172.21.15.94:0/774006868 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d815d5c0 con 0x7ff9d80c74a0 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9ddfc1700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 0x7ff9d8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:10.391 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dd7c0700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:10.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dcfbf700 1 --2- 172.21.15.94:0/774006868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80714c0 tx=0x7ff9c8009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=239acc31013cc0fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9cffff700 1 -- 172.21.15.94:0/774006868 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011830 con 0x7ff9d80c74a0 2024-09-13T18:05:10.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9cffff700 1 -- 172.21.15.94:0/774006868 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c8011990 con 0x7ff9d80c74a0 2024-09-13T18:05:10.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9cffff700 1 -- 172.21.15.94:0/774006868 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011d20 con 0x7ff9d80c74a0 2024-09-13T18:05:10.392 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- 172.21.15.94:0/774006868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 msgr2=0x7ff9d815e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/774006868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9d80714c0 tx=0x7ff9c8009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- 172.21.15.94:0/774006868 shutdown_connections 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/774006868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d80c74a0 0x7ff9d815e020 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.88:3300/0 conn(0x7ff9d8066570 0x7ff9d8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/774006868 >> v2:172.21.15.94:3300/0 conn(0x7ff9d80c70c0 0x7ff9d815dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- 172.21.15.94:0/774006868 >> 172.21.15.94:0/774006868 conn(0x7ff9d806a300 msgr2=0x7ff9d8070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- 172.21.15.94:0/774006868 shutdown_connections 2024-09-13T18:05:10.393 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.385+0000 7ff9dfa24700 1 -- 172.21.15.94:0/774006868 wait complete. 2024-09-13T18:05:10.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 Processor -- start 2024-09-13T18:05:10.394 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 -- start start 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 0x7ff9d8160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9d80c74a0 0x7ff9d81f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d80c9290 con 0x7ff9d80c70c0 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81f3080 con 0x7ff9d80c74a0 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dfa24700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d81f2d50 con 0x7ff9d8066570 2024-09-13T18:05:10.397 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43230/0 (socket says 172.21.15.94:43230) 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 -- 172.21.15.94:0/735892440 learned_addr learned my addr 172.21.15.94:0/735892440 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9ddfc1700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9d80c74a0 0x7ff9d81f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dcfbf700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 0x7ff9d8160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 -- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9d80c74a0 msgr2=0x7ff9d81f6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9d80c74a0 0x7ff9d81f6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 -- 172.21.15.94:0/735892440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 msgr2=0x7ff9d8160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 0x7ff9d8160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 -- 172.21.15.94:0/735892440 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d4009570 con 0x7ff9d8066570 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dcfbf700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 0x7ff9d8160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9dd7c0700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400ec10 tx=0x7ff9d400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.389+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400c850 con 0x7ff9d8066570 2024-09-13T18:05:10.398 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d400c9b0 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c80094b0 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d400cd20 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d80c94e0 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7ff9d4004320 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff9d4013820 con 0x7ff9d8066570 2024-09-13T18:05:10.399 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.393+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d81f2bb0 con 0x7ff9d8066570 2024-09-13T18:05:10.402 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.397+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7ff9d81f2bb0 con 0x7ff9d8066570 2024-09-13T18:05:10.478 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.473+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f91b2977-4a3d-45c1-82e1-acf5ea0406dc", "id": 1} v 0) v1 -- 0x7ff9d80c8420 con 0x7ff9d8066570 2024-09-13T18:05:10.484 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.477+0000 7ff9cdffb700 1 -- 172.21.15.94:0/735892440 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f91b2977-4a3d-45c1-82e1-acf5ea0406dc", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff9d4021060 con 0x7ff9d8066570 2024-09-13T18:05:10.484 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-09-13T18:05:10.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 msgr2=0x7ff9d81f3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.485 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400ec10 tx=0x7ff9d400ef20 comp rx=0 tx=0).stop 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 shutdown_connections 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9d80c74a0 0x7ff9d81f6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9d80c70c0 0x7ff9d8160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 --2- 172.21.15.94:0/735892440 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9d8066570 0x7ff9d81f3510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 >> 172.21.15.94:0/735892440 conn(0x7ff9d806a300 msgr2=0x7ff9d8156f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 shutdown_connections 2024-09-13T18:05:10.486 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.481+0000 7ff9dfa24700 1 -- 172.21.15.94:0/735892440 wait complete. 2024-09-13T18:05:10.502 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 062d570d-ebc4-400a-adbf-57fc169f2e40 2 2024-09-13T18:05:10.610 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 Processor -- start 2024-09-13T18:05:10.611 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 -- start start 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f41c8151060 0x7f41c80c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f41c80c4fb0 0x7f41c80c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c80c7420 con 0x7f41c80c2810 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c80c5900 con 0x7f41c80c4fb0 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41cd143700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c8070480 con 0x7f41c8151060 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41c6d9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f41c8151060 0x7f41c80c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.613 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41c6d9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f41c8151060 0x7f41c80c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38596/0 (socket says 172.21.15.94:38596) 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41c6d9d700 1 -- 172.21.15.94:0/3709779529 learned_addr learned my addr 172.21.15.94:0/3709779529 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.605+0000 7f41c759e700 1 --2- 172.21.15.94:0/3709779529 >> v2:172.21.15.88:3300/0 conn(0x7f41c80c4fb0 0x7f41c80c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c6d9d700 1 -- 172.21.15.94:0/3709779529 >> v2:172.21.15.88:3300/0 conn(0x7f41c80c4fb0 msgr2=0x7f41c80c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c6d9d700 1 --2- 172.21.15.94:0/3709779529 >> v2:172.21.15.88:3300/0 conn(0x7f41c80c4fb0 0x7f41c80c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c6d9d700 1 -- 172.21.15.94:0/3709779529 >> v1:172.21.15.94:6789/0 conn(0x7f41c80c2810 legacy=0x7f41c8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c6d9d700 1 -- 172.21.15.94:0/3709779529 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8070760 con 0x7f41c8151060 2024-09-13T18:05:10.614 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c6d9d700 1 --2- 172.21.15.94:0/3709779529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c8151060 0x7f41c80c6b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c93e0 tx=0x7f41b8009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9bd042f69ca4ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c5d9b700 1 -- 172.21.15.94:0/3709779529 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800b8a0 con 0x7f41c8151060 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c5d9b700 1 -- 172.21.15.94:0/3709779529 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b800ba00 con 0x7f41c8151060 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41c5d9b700 1 -- 172.21.15.94:0/3709779529 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800bd90 con 0x7f41c8151060 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 -- 172.21.15.94:0/3709779529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c8151060 msgr2=0x7f41c80c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 --2- 172.21.15.94:0/3709779529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c8151060 0x7f41c80c6b80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f41c80c93e0 tx=0x7f41b8009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 -- 172.21.15.94:0/3709779529 shutdown_connections 2024-09-13T18:05:10.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 --2- 172.21.15.94:0/3709779529 >> v2:172.21.15.88:3300/0 conn(0x7f41c80c4fb0 0x7f41c80c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 --2- 172.21.15.94:0/3709779529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c8151060 0x7f41c80c6b80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 -- 172.21.15.94:0/3709779529 >> 172.21.15.94:0/3709779529 conn(0x7f41c806a400 msgr2=0x7f41c806a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 -- 172.21.15.94:0/3709779529 shutdown_connections 2024-09-13T18:05:10.616 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.609+0000 7f41cd143700 1 -- 172.21.15.94:0/3709779529 wait complete. 2024-09-13T18:05:10.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 Processor -- start 2024-09-13T18:05:10.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- start start 2024-09-13T18:05:10.620 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41c80c4fb0 0x7f41c81f0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 0x7f41c81f0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81e1460 con 0x7f41c8151060 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81efe20 con 0x7f41c80c2810 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81e0330 con 0x7f41c80c4fb0 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38600/0 (socket says 172.21.15.94:38600) 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 -- 172.21.15.94:0/510544996 learned_addr learned my addr 172.21.15.94:0/510544996 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c659c700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41c80c4fb0 0x7f41c81f0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c759e700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 0x7f41c81f0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 -- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41c80c4fb0 msgr2=0x7f41c81f0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.621 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41c80c4fb0 0x7f41c81f0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 -- 172.21.15.94:0/510544996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 msgr2=0x7f41c81f0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 0x7f41c81f0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 -- 172.21.15.94:0/510544996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b8009570 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c759e700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 0x7f41c81f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41c6d9d700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41c80cc960 tx=0x7f41b8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b80036c0 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b801f070 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c81e0610 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8003a80 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81e0bd0 con 0x7f41c80c2810 2024-09-13T18:05:10.622 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f41b8021030 con 0x7f41c80c2810 2024-09-13T18:05:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.613+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f41b801ab30 con 0x7f41c80c2810 2024-09-13T18:05:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.617+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8157210 con 0x7f41c80c2810 2024-09-13T18:05:10.623 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.617+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f41b8015020 con 0x7f41c80c2810 2024-09-13T18:05:10.684 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:10.677+0000 7f2f9e82f2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:05:10.696 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.689+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "062d570d-ebc4-400a-adbf-57fc169f2e40", "id": 2} v 0) v1 -- 0x7f41c806f3f0 con 0x7f41c80c2810 2024-09-13T18:05:10.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41af7fe700 1 -- 172.21.15.94:0/510544996 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "062d570d-ebc4-400a-adbf-57fc169f2e40", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f41b801add0 con 0x7f41c80c2810 2024-09-13T18:05:10.702 INFO:teuthology.orchestra.run.smithi094.stdout:2 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 msgr2=0x7f41c80c9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f41c80cc960 tx=0x7f41b8004770 comp rx=0 tx=0).stop 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 shutdown_connections 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f41c80c4fb0 0x7f41c81f0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f41c8151060 0x7f41c81f0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 --2- 172.21.15.94:0/510544996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f41c80c2810 0x7f41c80c9a10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 >> 172.21.15.94:0/510544996 conn(0x7f41c806a400 msgr2=0x7f41c8149f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 shutdown_connections 2024-09-13T18:05:10.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.697+0000 7f41cd143700 1 -- 172.21.15.94:0/510544996 wait complete. 2024-09-13T18:05:10.717 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new d75ac126-5892-4429-a31a-e19dc06bda6c 3 2024-09-13T18:05:10.743 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:10.737+0000 7f2f9e82f2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:05:10.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.821+0000 7f7a7f59e700 1 Processor -- start 2024-09-13T18:05:10.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.821+0000 7f7a7f59e700 1 -- start start 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a8006bf60 0x7f7a800c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a800c3b40 con 0x7f7a800c6700 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a800c62e0 con 0x7f7a8006bf60 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a800c3f60 con 0x7f7a8006bb80 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43262/0 (socket says 172.21.15.94:43262) 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 -- 172.21.15.94:0/2603458320 learned_addr learned my addr 172.21.15.94:0/2603458320 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7dd9b700 1 --2- 172.21.15.94:0/2603458320 >> v2:172.21.15.88:3300/0 conn(0x7f7a8006bf60 0x7f7a800c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 -- 172.21.15.94:0/2603458320 >> v2:172.21.15.88:3300/0 conn(0x7f7a8006bf60 msgr2=0x7f7a800c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 --2- 172.21.15.94:0/2603458320 >> v2:172.21.15.88:3300/0 conn(0x7f7a8006bf60 0x7f7a800c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 -- 172.21.15.94:0/2603458320 >> v1:172.21.15.88:6789/0 conn(0x7f7a800c6700 legacy=0x7f7a80150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 -- 172.21.15.94:0/2603458320 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a800c4240 con 0x7f7a8006bb80 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7e59c700 1 --2- 172.21.15.94:0/2603458320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009910 tx=0x7f7a70009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f19e1f29c2370d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7d59a700 1 -- 172.21.15.94:0/2603458320 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a7000ba60 con 0x7f7a8006bb80 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7d59a700 1 -- 172.21.15.94:0/2603458320 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7000bbc0 con 0x7f7a8006bb80 2024-09-13T18:05:10.832 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7d59a700 1 -- 172.21.15.94:0/2603458320 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70009e60 con 0x7f7a8006bb80 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- 172.21.15.94:0/2603458320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 msgr2=0x7f7a800c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/2603458320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009910 tx=0x7f7a70009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- 172.21.15.94:0/2603458320 shutdown_connections 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/2603458320 >> v2:172.21.15.88:3300/0 conn(0x7f7a8006bf60 0x7f7a800c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/2603458320 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bb80 0x7f7a800c3600 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- 172.21.15.94:0/2603458320 >> 172.21.15.94:0/2603458320 conn(0x7f7a8006ddb0 msgr2=0x7f7a8006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- 172.21.15.94:0/2603458320 shutdown_connections 2024-09-13T18:05:10.833 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.825+0000 7f7a7f59e700 1 -- 172.21.15.94:0/2603458320 wait complete. 2024-09-13T18:05:10.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 Processor -- start 2024-09-13T18:05:10.834 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- start start 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bf60 0x7f7a801e2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 0x7f7a801e2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80152040 con 0x7f7a800c6700 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80153720 con 0x7f7a8006bb80 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a80151a30 con 0x7f7a8006bf60 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7dd9b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bf60 0x7f7a801e2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38616/0 (socket says 172.21.15.94:38616) 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 -- 172.21.15.94:0/729825399 learned_addr learned my addr 172.21.15.94:0/729825399 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:10.837 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7ed9d700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 0x7f7a801e2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 -- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bf60 msgr2=0x7f7a801e2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bf60 0x7f7a801e2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 -- 172.21.15.94:0/729825399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 msgr2=0x7f7a801e2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 0x7f7a801e2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 -- 172.21.15.94:0/729825399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009570 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7ed9d700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 0x7f7a801e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7e59c700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a70000c00 tx=0x7f7a70004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a700044d0 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7001f070 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a80153990 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003900 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a80151cd0 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7a7001a430 con 0x7f7a8006bb80 2024-09-13T18:05:10.838 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.829+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7a70021070 con 0x7f7a8006bb80 2024-09-13T18:05:10.839 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.833+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a800678f0 con 0x7f7a8006bb80 2024-09-13T18:05:10.841 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.837+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f7a70015020 con 0x7f7a8006bb80 2024-09-13T18:05:10.895 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:10.893+0000 7fd6d24e72c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:05:10.918 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.913+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d75ac126-5892-4429-a31a-e19dc06bda6c", "id": 3} v 0) v1 -- 0x7f7a800746a0 con 0x7f7a8006bb80 2024-09-13T18:05:10.920 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:10.913+0000 7f2f9e82f2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:05:10.928 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.921+0000 7f7a6effd700 1 -- 172.21.15.94:0/729825399 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d75ac126-5892-4429-a31a-e19dc06bda6c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7a800746a0 con 0x7f7a8006bb80 2024-09-13T18:05:10.929 INFO:teuthology.orchestra.run.smithi094.stdout:3 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 msgr2=0x7f7a801f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7a70000c00 tx=0x7f7a70004770 comp rx=0 tx=0).stop 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 shutdown_connections 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a8006bf60 0x7f7a801e2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a800c6700 0x7f7a801e2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.930 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 --2- 172.21.15.94:0/729825399 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a8006bb80 0x7f7a801f1f00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:10.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 >> 172.21.15.94:0/729825399 conn(0x7f7a8006ddb0 msgr2=0x7f7a8014e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:10.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 shutdown_connections 2024-09-13T18:05:10.931 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:10.925+0000 7f7a7f59e700 1 -- 172.21.15.94:0/729825399 wait complete. 2024-09-13T18:05:10.944 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new c0ee9a97-1888-4ccc-af94-07dae043cd86 4 2024-09-13T18:05:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 Processor -- start 2024-09-13T18:05:11.057 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- start start 2024-09-13T18:05:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f55c0071760 0x7f55c0152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c00c5fe0 con 0x7f55c0071b40 2024-09-13T18:05:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c00c5130 con 0x7f55c015ab70 2024-09-13T18:05:11.059 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c00c4240 con 0x7f55c0071760 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f55c0071760 0x7f55c0152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f55c0071760 0x7f55c0152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38626/0 (socket says 172.21.15.94:38626) 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 -- 172.21.15.94:0/3232211482 learned_addr learned my addr 172.21.15.94:0/3232211482 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 -- 172.21.15.94:0/3232211482 >> v1:172.21.15.94:6789/0 conn(0x7f55c015ab70 legacy=0x7f55c01637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 -- 172.21.15.94:0/3232211482 >> v1:172.21.15.88:6789/0 conn(0x7f55c0071b40 legacy=0x7f55c015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 -- 172.21.15.94:0/3232211482 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00c53d0 con 0x7f55c0071760 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55bffff700 1 --2- 172.21.15.94:0/3232211482 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071760 0x7f55c0152ca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009910 tx=0x7f55b0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c37569d39526318 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55beffd700 1 -- 172.21.15.94:0/3232211482 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b000ba60 con 0x7f55c0071760 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55beffd700 1 -- 172.21.15.94:0/3232211482 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b000bbc0 con 0x7f55c0071760 2024-09-13T18:05:11.060 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55beffd700 1 -- 172.21.15.94:0/3232211482 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0009e60 con 0x7f55c0071760 2024-09-13T18:05:11.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- 172.21.15.94:0/3232211482 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071760 msgr2=0x7f55c0152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3232211482 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071760 0x7f55c0152ca0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f55b0009910 tx=0x7f55b0009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:11.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- 172.21.15.94:0/3232211482 shutdown_connections 2024-09-13T18:05:11.061 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3232211482 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071760 0x7f55c0152ca0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- 172.21.15.94:0/3232211482 >> 172.21.15.94:0/3232211482 conn(0x7f55c00c7120 msgr2=0x7f55c00c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- 172.21.15.94:0/3232211482 shutdown_connections 2024-09-13T18:05:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.053+0000 7f55c52fc700 1 -- 172.21.15.94:0/3232211482 wait complete. 2024-09-13T18:05:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 Processor -- start 2024-09-13T18:05:11.062 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 -- start start 2024-09-13T18:05:11.063 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071b40 0x7f55c0145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 0x7f55c01e3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c01447b0 con 0x7f55c015ab70 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0144d70 con 0x7f55c0071b40 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c52fc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c0143090 con 0x7f55c0071760 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43282/0 (socket says 172.21.15.94:43282) 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 -- 172.21.15.94:0/3303456924 learned_addr learned my addr 172.21.15.94:0/3303456924 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.064 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bf7fe700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071b40 0x7f55c0145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c4afb700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 0x7f55c01e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 -- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071b40 msgr2=0x7f55c0145200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071b40 0x7f55c0145200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 -- 172.21.15.94:0/3303456924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 msgr2=0x7f55c01e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 0x7f55c01e3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 -- 172.21.15.94:0/3303456924 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0009570 con 0x7f55c0071760 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55c4afb700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 0x7f55c01e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:11.065 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.057+0000 7f55bffff700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006f80 tx=0x7f55b0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.066 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0004610 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b001f070 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c0143310 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00038e0 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c0144a00 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f55b0003d40 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f55b0021070 con 0x7f55c0071760 2024-09-13T18:05:11.067 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.061+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c0144bc0 con 0x7f55c0071760 2024-09-13T18:05:11.069 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.065+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f55b0015020 con 0x7f55c0071760 2024-09-13T18:05:11.140 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.133+0000 7f2f9e82f2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:05:11.143 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.137+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c0ee9a97-1888-4ccc-af94-07dae043cd86", "id": 4} v 0) v1 -- 0x7f55c00722b0 con 0x7f55c0071760 2024-09-13T18:05:11.154 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55bcff9700 1 -- 172.21.15.94:0/3303456924 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0ee9a97-1888-4ccc-af94-07dae043cd86", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55b0026480 con 0x7f55c0071760 2024-09-13T18:05:11.154 INFO:teuthology.orchestra.run.smithi094.stdout:4 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 msgr2=0x7f55c015ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55b0006f80 tx=0x7f55b0004770 comp rx=0 tx=0).stop 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 shutdown_connections 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55c015ab70 0x7f55c01e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55c0071b40 0x7f55c0145200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.155 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 --2- 172.21.15.94:0/3303456924 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55c0071760 0x7f55c015ba10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 >> 172.21.15.94:0/3303456924 conn(0x7f55c00c7120 msgr2=0x7f55c014d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 shutdown_connections 2024-09-13T18:05:11.156 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.149+0000 7f55c52fc700 1 -- 172.21.15.94:0/3303456924 wait complete. 2024-09-13T18:05:11.169 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 52de53d5-cf57-4a22-8b19-b0f8ca20a920 5 2024-09-13T18:05:11.192 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.185+0000 7f2f9e82f2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:05:11.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 Processor -- start 2024-09-13T18:05:11.280 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 -- start start 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f200c0c6a70 0x7f200c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f200c0c6e50 0x7f200c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c070830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c159a80 con 0x7f200c0c6a70 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c06fa70 con 0x7f200c0c6e50 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.273+0000 7f200b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c06fd50 con 0x7f200c06ef30 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f200c0c6e50 0x7f200c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.283 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f200c0c6e50 0x7f200c06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38634/0 (socket says 172.21.15.94:38634) 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 -- 172.21.15.94:0/1906488209 learned_addr learned my addr 172.21.15.94:0/1906488209 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200a59c700 1 --2- 172.21.15.94:0/1906488209 >> v2:172.21.15.88:3300/0 conn(0x7f200c0c6a70 0x7f200c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 -- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 msgr2=0x7f200c070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 --2- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 -- 172.21.15.94:0/1906488209 >> v2:172.21.15.88:3300/0 conn(0x7f200c0c6a70 msgr2=0x7f200c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 --2- 172.21.15.94:0/1906488209 >> v2:172.21.15.88:3300/0 conn(0x7f200c0c6a70 0x7f200c0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 -- 172.21.15.94:0/1906488209 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c070030 con 0x7f200c0c6e50 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f2009d9b700 1 --2- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c06c6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f200c06c380 tx=0x7f2000009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9740cfd1e31837b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.284 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200959a700 1 -- 172.21.15.94:0/1906488209 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000011830 con 0x7f200c0c6e50 2024-09-13T18:05:11.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200959a700 1 -- 172.21.15.94:0/1906488209 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2000011990 con 0x7f200c0c6e50 2024-09-13T18:05:11.285 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200959a700 1 -- 172.21.15.94:0/1906488209 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000011d20 con 0x7f200c0c6e50 2024-09-13T18:05:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 msgr2=0x7f200c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 --2- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c06c6d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f200c06c380 tx=0x7f2000009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- 172.21.15.94:0/1906488209 shutdown_connections 2024-09-13T18:05:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 --2- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.289 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 --2- 172.21.15.94:0/1906488209 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c06c6d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 --2- 172.21.15.94:0/1906488209 >> v2:172.21.15.88:3300/0 conn(0x7f200c0c6a70 0x7f200c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- 172.21.15.94:0/1906488209 >> 172.21.15.94:0/1906488209 conn(0x7f200c0c78f0 msgr2=0x7f200c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- 172.21.15.94:0/1906488209 shutdown_connections 2024-09-13T18:05:11.290 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- 172.21.15.94:0/1906488209 wait complete. 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 Processor -- start 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.277+0000 7f200b59e700 1 -- start start 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 0x7f200c0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c1550e0 con 0x7f200c0c6a70 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c153ea0 con 0x7f200c0c6e50 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c154d00 con 0x7f200c06ef30 2024-09-13T18:05:11.293 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200a59c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:38636/0 (socket says 172.21.15.94:38636) 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 -- 172.21.15.94:0/1956929280 learned_addr learned my addr 172.21.15.94:0/1956929280 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f2009d9b700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 0x7f200c0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 -- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 msgr2=0x7f200c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c1547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 -- 172.21.15.94:0/1956929280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 msgr2=0x7f200c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 0x7f200c0b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 -- 172.21.15.94:0/1956929280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009570 con 0x7f200c0c6e50 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f2009d9b700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 0x7f200c0b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:11.294 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200ad9d700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f200400efc0 tx=0x7f200400c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200400cb80 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200400f040 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c0c1dd0 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2004014480 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c153bc0 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f20040148e0 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f200401d400 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.281+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c0bff30 con 0x7f200c0c6e50 2024-09-13T18:05:11.295 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.285+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f200c0bff30 con 0x7f200c0c6e50 2024-09-13T18:05:11.366 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.361+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "52de53d5-cf57-4a22-8b19-b0f8ca20a920", "id": 5} v 0) v1 -- 0x7f200c0c83e0 con 0x7f200c0c6e50 2024-09-13T18:05:11.371 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.365+0000 7f2f9e82f2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:05:11.376 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.369+0000 7f1ffaffd700 1 -- 172.21.15.94:0/1956929280 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52de53d5-cf57-4a22-8b19-b0f8ca20a920", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2004018020 con 0x7f200c0c6e50 2024-09-13T18:05:11.376 INFO:teuthology.orchestra.run.smithi094.stdout:5 2024-09-13T18:05:11.377 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 msgr2=0x7f200c0c0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f200400efc0 tx=0x7f200400c0c0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 shutdown_connections 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f200c0c6e50 0x7f200c0c0210 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200c0c6a70 0x7f200c0b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 --2- 172.21.15.94:0/1956929280 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f200c06ef30 0x7f200c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 >> 172.21.15.94:0/1956929280 conn(0x7f200c0c78f0 msgr2=0x7f200c151560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.378 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 shutdown_connections 2024-09-13T18:05:11.379 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.373+0000 7f200b59e700 1 -- 172.21.15.94:0/1956929280 wait complete. 2024-09-13T18:05:11.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 200d2417-675c-47c3-ab97-98ab8b02bc55 6 2024-09-13T18:05:11.437 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.433+0000 7f2f9e82f2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:05:11.503 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.497+0000 7f2f9e82f2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:05:11.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.533+0000 7f3eb39d0700 1 Processor -- start 2024-09-13T18:05:11.540 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.533+0000 7f3eb39d0700 1 -- start start 2024-09-13T18:05:11.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 0x7f3eac0c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3eac0c2610 0x7f3eac156920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eac156490 con 0x7f3eac0c8470 2024-09-13T18:05:11.545 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eac159be0 con 0x7f3eac0c2610 2024-09-13T18:05:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac159ec0 con 0x7f3eac0c8850 2024-09-13T18:05:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3eac0c2610 0x7f3eac156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb176c700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3eac0c8470 0x7f3eac159320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58536/0 (socket says 172.21.15.94:58536) 2024-09-13T18:05:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb0f6b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 0x7f3eac0c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.546 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb176c700 1 -- 172.21.15.94:0/1977687445 learned_addr learned my addr 172.21.15.94:0/1977687445 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 -- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 msgr2=0x7f3eac0c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 0x7f3eac0c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 -- 172.21.15.94:0/1977687445 >> v1:172.21.15.94:6789/0 conn(0x7f3eac0c8470 legacy=0x7f3eac159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3ea3fff700 1 -- 172.21.15.94:0/1977687445 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483439616 0 0) 0x7f3eac156490 con 0x7f3eac0c8470 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 -- 172.21.15.94:0/1977687445 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac155e40 con 0x7f3eac0c2610 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb0f6b700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 0x7f3eac0c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb1f6d700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac156920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009d90 tx=0x7f3ea400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b74f5c2a993ec50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3ea3fff700 1 -- 172.21.15.94:0/1977687445 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400e070 con 0x7f3eac0c2610 2024-09-13T18:05:11.547 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3ea3fff700 1 -- 172.21.15.94:0/1977687445 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400bb20 con 0x7f3eac0c2610 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3ea3fff700 1 -- 172.21.15.94:0/1977687445 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4012430 con 0x7f3eac0c2610 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 msgr2=0x7f3eac156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac156920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4009d90 tx=0x7f3ea400b330 comp rx=0 tx=0).stop 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- 172.21.15.94:0/1977687445 shutdown_connections 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac156920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/1977687445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8850 0x7f3eac0c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- 172.21.15.94:0/1977687445 >> 172.21.15.94:0/1977687445 conn(0x7f3eac06ffb0 msgr2=0x7f3eac070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- 172.21.15.94:0/1977687445 shutdown_connections 2024-09-13T18:05:11.548 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.537+0000 7f3eb39d0700 1 -- 172.21.15.94:0/1977687445 wait complete. 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 Processor -- start 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- start start 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0c8850 0x7f3eac147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac155970 con 0x7f3eac0c8850 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac0cae30 con 0x7f3eac0c2610 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eac06fda0 con 0x7f3eac0c8470 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb176c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43322/0 (socket says 172.21.15.94:43322) 2024-09-13T18:05:11.551 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 -- 172.21.15.94:0/3846271640 learned_addr learned my addr 172.21.15.94:0/3846271640 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb1f6d700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0c8850 0x7f3eac147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 -- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 msgr2=0x7f3eac06f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac06f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 -- 172.21.15.94:0/3846271640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0c8850 msgr2=0x7f3eac147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0c8850 0x7f3eac147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 -- 172.21.15.94:0/3846271640 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0094b0 con 0x7f3eac0c8470 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb176c700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb0f6b700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00ebe0 tx=0x7f3e9c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00c850 con 0x7f3eac0c8470 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00c9b0 con 0x7f3eac0c8470 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea4009a70 con 0x7f3eac0c8470 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00cd40 con 0x7f3eac0c8470 2024-09-13T18:05:11.552 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eac155b50 con 0x7f3eac0c8470 2024-09-13T18:05:11.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3e9c005d40 con 0x7f3eac0c8470 2024-09-13T18:05:11.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f3e9c013a60 con 0x7f3eac0c8470 2024-09-13T18:05:11.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.541+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eac156900 con 0x7f3eac0c8470 2024-09-13T18:05:11.553 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.545+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3e9c021060 con 0x7f3eac0c8470 2024-09-13T18:05:11.619 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.613+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "200d2417-675c-47c3-ab97-98ab8b02bc55", "id": 6} v 0) v1 -- 0x7f3eac070710 con 0x7f3eac0c8470 2024-09-13T18:05:11.629 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3ea1ffb700 1 -- 172.21.15.94:0/3846271640 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "200d2417-675c-47c3-ab97-98ab8b02bc55", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e9c017070 con 0x7f3eac0c8470 2024-09-13T18:05:11.630 INFO:teuthology.orchestra.run.smithi094.stdout:6 2024-09-13T18:05:11.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 msgr2=0x7f3eac14cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.631 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00ebe0 tx=0x7f3e9c00eef0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 shutdown_connections 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3eac0c8470 0x7f3eac14cb10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3eac0c8850 0x7f3eac147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 --2- 172.21.15.94:0/3846271640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3eac0c2610 0x7f3eac06f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 >> 172.21.15.94:0/3846271640 conn(0x7f3eac06ffb0 msgr2=0x7f3eac14ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 shutdown_connections 2024-09-13T18:05:11.632 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.625+0000 7f3eb39d0700 1 -- 172.21.15.94:0/3846271640 wait complete. 2024-09-13T18:05:11.647 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 96a9d816-3dbf-4c9b-a672-6dce5b439c12 7 2024-09-13T18:05:11.683 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:11.681+0000 7fd6d24e72c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:05:11.742 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:11.737+0000 7fd6d24e72c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:05:11.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 Processor -- start 2024-09-13T18:05:11.757 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- start start 2024-09-13T18:05:11.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcfb0153000 0x7fcfb015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 0x7fcfb00caf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.760 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00cb8a0 con 0x7fcfb00cb4a0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00c39a0 con 0x7fcfb0153000 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00b3ad0 con 0x7fcfb006eea0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb548c700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fcfb00cb4a0 0x7fcfb00c3dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:58546/0 (socket says 172.21.15.94:58546) 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb548c700 1 -- 172.21.15.94:0/464755961 learned_addr learned my addr 172.21.15.94:0/464755961 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 --2- 172.21.15.94:0/464755961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 0x7fcfb00caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb4c8b700 1 --2- 172.21.15.94:0/464755961 >> v2:172.21.15.88:3300/0 conn(0x7fcfb0153000 0x7fcfb015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 -- 172.21.15.94:0/464755961 >> v2:172.21.15.88:3300/0 conn(0x7fcfb0153000 msgr2=0x7fcfb015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 --2- 172.21.15.94:0/464755961 >> v2:172.21.15.88:3300/0 conn(0x7fcfb0153000 0x7fcfb015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 -- 172.21.15.94:0/464755961 >> v1:172.21.15.94:6789/0 conn(0x7fcfb00cb4a0 legacy=0x7fcfb00c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 -- 172.21.15.94:0/464755961 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb015d310 con 0x7fcfb006eea0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaffff700 1 --2- 172.21.15.94:0/464755961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 0x7fcfb00caf60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009850 tx=0x7fcf9c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62182b09b903fa1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaf7fe700 1 -- 172.21.15.94:0/464755961 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011830 con 0x7fcfb006eea0 2024-09-13T18:05:11.761 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaf7fe700 1 -- 172.21.15.94:0/464755961 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c011990 con 0x7fcfb006eea0 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfaf7fe700 1 -- 172.21.15.94:0/464755961 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c011d20 con 0x7fcfb006eea0 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/464755961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 msgr2=0x7fcfb00caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/464755961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 0x7fcfb00caf60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009850 tx=0x7fcf9c009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/464755961 shutdown_connections 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/464755961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb006eea0 0x7fcfb00caf60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/464755961 >> v2:172.21.15.88:3300/0 conn(0x7fcfb0153000 0x7fcfb015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/464755961 >> 172.21.15.94:0/464755961 conn(0x7fcfb0071660 msgr2=0x7fcfb0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/464755961 shutdown_connections 2024-09-13T18:05:11.762 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.753+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/464755961 wait complete. 2024-09-13T18:05:11.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 Processor -- start 2024-09-13T18:05:11.763 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 -- start start 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 0x7fcfb00c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 0x7fcfb00aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 0x7fcfb00c7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c5c50 con 0x7fcfb006eea0 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00ce290 con 0x7fcfb0153000 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb5c8d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01eef40 con 0x7fcfb00cb4a0 2024-09-13T18:05:11.765 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 0x7fcfb00aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb4c8b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 0x7fcfb00c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb548c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 0x7fcfb00c7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfaffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 0x7fcfb00aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:43354/0 (socket says 172.21.15.94:43354) 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb4c8b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 0x7fcfb00c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.94:56044/0 (socket says 172.21.15.94:56044) 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfaffff700 1 -- 172.21.15.94:0/2833363013 learned_addr learned my addr 172.21.15.94:0/2833363013 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb548c700 1 -- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 msgr2=0x7fcfb00aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.757+0000 7fcfb548c700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 0x7fcfb00aaa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb548c700 1 -- 172.21.15.94:0/2833363013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 msgr2=0x7fcfb00c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb548c700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 0x7fcfb00c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb548c700 1 -- 172.21.15.94:0/2833363013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9c0094b0 con 0x7fcfb0153000 2024-09-13T18:05:11.766 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb548c700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 0x7fcfb00c7e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800caa0 tx=0x7fcfa800cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007480 con 0x7fcfb0153000 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa80075e0 con 0x7fcfb0153000 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb01ef220 con 0x7fcfb0153000 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa8007950 con 0x7fcfb0153000 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00ce570 con 0x7fcfb0153000 2024-09-13T18:05:11.767 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcfa801c440 con 0x7fcfb0153000 2024-09-13T18:05:11.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fcfa8012a60 con 0x7fcfb0153000 2024-09-13T18:05:11.768 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.761+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb00c60e0 con 0x7fcfb0153000 2024-09-13T18:05:11.771 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.765+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fcfb00c60e0 con 0x7fcfb0153000 2024-09-13T18:05:11.850 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.845+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96a9d816-3dbf-4c9b-a672-6dce5b439c12", "id": 7} v 0) v1 -- 0x7fcfb01ef3b0 con 0x7fcfb0153000 2024-09-13T18:05:11.860 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.853+0000 7fcfad7fa700 1 -- 172.21.15.94:0/2833363013 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96a9d816-3dbf-4c9b-a672-6dce5b439c12", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcfa8021060 con 0x7fcfb0153000 2024-09-13T18:05:11.860 INFO:teuthology.orchestra.run.smithi094.stdout:7 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 msgr2=0x7fcfb00c7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 0x7fcfb00c7e10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcfa800caa0 tx=0x7fcfa800cad0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 shutdown_connections 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcfb00cb4a0 0x7fcfb00aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcfb0153000 0x7fcfb00c7e10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.862 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 --2- 172.21.15.94:0/2833363013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcfb006eea0 0x7fcfb00c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:11.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 >> 172.21.15.94:0/2833363013 conn(0x7fcfb0071660 msgr2=0x7fcfb0071a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:11.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 shutdown_connections 2024-09-13T18:05:11.863 INFO:teuthology.orchestra.run.smithi094.stderr:2024-09-13T18:05:11.857+0000 7fcfb5c8d700 1 -- 172.21.15.94:0/2833363013 wait complete. 2024-09-13T18:05:11.874 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:05:11.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:05:11.877 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:05:11.877 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:05:11.877 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:05:11.879 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:05:11.879 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:05:11.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:05:11.882 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:05:11.882 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:05:11.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:05:11.884 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:05:11.885 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:05:11.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:05:11.887 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:05:11.887 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:05:11.887 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:05:11.889 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:05:11.890 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:05:11.890 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:05:11.892 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:05:11.892 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:05:11.892 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:05:11.894 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:05:11.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:11.905 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:11.901+0000 7f2f9e82f2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:05:11.942 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:11.937+0000 7fd6d24e72c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:05:12.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 Processor -- start 2024-09-13T18:05:12.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 -- start start 2024-09-13T18:05:12.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e8151210 0x7fd4e80723b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd4e80c5520 0x7fd4e806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e80c5d60 con 0x7fd4e806e130 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80c2bf0 con 0x7fd4e80c5520 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ee804700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80c5a80 con 0x7fd4e8151210 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ecda1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd4e806e130 0x7fd4e8156f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40240/0 (socket says 172.21.15.88:40240) 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4ecda1700 1 -- 172.21.15.88:0/1795781641 learned_addr learned my addr 172.21.15.88:0/1795781641 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1795781641 >> v2:172.21.15.94:3300/0 conn(0x7fd4e80c5520 0x7fd4e806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:12.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e7fff700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e8151210 0x7fd4e80723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923252086 0 0) 0x7fd4e0001490 con 0x7fd4e806e130 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d00035d0 con 0x7fd4e806e130 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334293746 0 0) 0x7fd4d00035d0 con 0x7fd4e806e130 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e8151210 msgr2=0x7fd4e80723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e8151210 0x7fd4e80723b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1795781641 >> v1:172.21.15.88:6789/0 conn(0x7fd4e806e130 legacy=0x7fd4e8156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1795781641 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e80c1e30 con 0x7fd4e80c5520 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e80c5520 0x7fd4e806dbf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009850 tx=0x7fd4d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8df4d593524f9ca server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0001b80 con 0x7fd4e80c5520 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d8004030 con 0x7fd4e80c5520 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.001+0000 7fd4e6ffd700 1 -- 172.21.15.88:0/1795781641 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d80043e0 con 0x7fd4e80c5520 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e80c5520 msgr2=0x7fd4e806dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:12.007 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e80c5520 0x7fd4e806dbf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009850 tx=0x7fd4d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1795781641 shutdown_connections 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e80c5520 0x7fd4e806dbf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1795781641 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e8151210 0x7fd4e80723b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1795781641 >> 172.21.15.88:0/1795781641 conn(0x7fd4e80ca790 msgr2=0x7fd4e80caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1795781641 shutdown_connections 2024-09-13T18:05:12.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1795781641 wait complete. 2024-09-13T18:05:12.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 Processor -- start 2024-09-13T18:05:12.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- start start 2024-09-13T18:05:12.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e806e130 0x7fd4e81ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:12.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e8151210 0x7fd4e81f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81dcfd0 con 0x7fd4e806e130 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81dd200 con 0x7fd4e8151210 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81dd490 con 0x7fd4e80c5520 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e806e130 0x7fd4e81ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:43778/0 (socket says 172.21.15.88:43778) 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1849533135 learned_addr learned my addr 172.21.15.88:0/1849533135 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ecda1700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e8151210 0x7fd4e81f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e8151210 msgr2=0x7fd4e81f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e8151210 0x7fd4e81f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1849533135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e806e130 msgr2=0x7fd4e81ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:12.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e806e130 0x7fd4e81ddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 -- 172.21.15.88:0/1849533135 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d80094b0 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e77fe700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80090b0 tx=0x7fd4d8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8003d10 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d801f070 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e8153d20 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.005+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8011870 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.009+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e8154630 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.009+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fd4d8011cd0 con 0x7fd4e80c5520 2024-09-13T18:05:12.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.009+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd4d8021070 con 0x7fd4e80c5520 2024-09-13T18:05:12.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.013+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e8153eb0 con 0x7fd4e80c5520 2024-09-13T18:05:12.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.013+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fd4d8026480 con 0x7fd4e80c5520 2024-09-13T18:05:12.043 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:12.037+0000 7f2f9e82f2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:05:12.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4e81515f0 con 0x7fd4e80c5520 2024-09-13T18:05:12.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4e4ff9700 1 -- 172.21.15.88:0/1849533135 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd4d80266d0 con 0x7fd4e80c5520 2024-09-13T18:05:12.088 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:12.088 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:11.851494+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:12.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 msgr2=0x7fd4e806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:12.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd4d80090b0 tx=0x7fd4d8004770 comp rx=0 tx=0).stop 2024-09-13T18:05:12.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 shutdown_connections 2024-09-13T18:05:12.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd4e80c5520 0x7fd4e806b9e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd4e8151210 0x7fd4e81f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 --2- 172.21.15.88:0/1849533135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd4e806e130 0x7fd4e81ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:12.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 >> 172.21.15.88:0/1849533135 conn(0x7fd4e80ca790 msgr2=0x7fd4e80c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:12.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 shutdown_connections 2024-09-13T18:05:12.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:12.085+0000 7fd4ee804700 1 -- 172.21.15.88:0/1849533135 wait complete. 2024-09-13T18:05:12.101 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:05:12.101 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:05:12.179 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.177+0000 7fd6d24e72c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:05:12.229 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.225+0000 7fd6d24e72c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:05:12.251 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-09-13T18:05:12.245+0000 7fc2b03e9880 -1 Falling back to public interface 2024-09-13T18:05:12.374 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:12.369+0000 7f2f9e82f2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:05:12.400 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.397+0000 7fd6d24e72c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:05:12.463 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.461+0000 7fd6d24e72c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:05:12.500 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-09-13T18:05:12.497+0000 7f2d567f0880 -1 Falling back to public interface 2024-09-13T18:05:12.504 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-09-13T18:05:12.501+0000 7fc6e93aa880 -1 Falling back to public interface 2024-09-13T18:05:12.520 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-09-13T18:05:12.517+0000 7efcdd2f7880 -1 Falling back to public interface 2024-09-13T18:05:12.522 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-09-13T18:05:12.517+0000 7fa65376d880 -1 Falling back to public interface 2024-09-13T18:05:12.523 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-09-13T18:05:12.521+0000 7efc51a39880 -1 Falling back to public interface 2024-09-13T18:05:12.526 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-09-13T18:05:12.521+0000 7f0712806880 -1 Falling back to public interface 2024-09-13T18:05:12.530 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.529+0000 7fd6d24e72c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:05:12.534 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-09-13T18:05:12.529+0000 7f2591669880 -1 Falling back to public interface 2024-09-13T18:05:12.567 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:12.561+0000 7f2f9e82f2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:05:12.629 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:12.625+0000 7f2f9e82f2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:05:12.790 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:12.785+0000 7f2f9e82f2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:05:12.906 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:12.928 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:12.925+0000 7fd6d24e72c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:05:13.006 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 Processor -- start 2024-09-13T18:05:13.007 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- start start 2024-09-13T18:05:13.007 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d740c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:13.007 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d74066200 0x7f3d740afd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:13.007 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d74153800 con 0x7f3d740b02d0 2024-09-13T18:05:13.007 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740c77e0 con 0x7f3d74066200 2024-09-13T18:05:13.008 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c5de0 con 0x7f3d74159b90 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d74066200 0x7f3d740afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d73fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d740c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d74066200 0x7f3d740afd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:52152/0 (socket says 172.21.15.88:52152) 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/4028747110 learned_addr learned my addr 172.21.15.88:0/4028747110 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 msgr2=0x7f3d740c6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 --2- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d740c6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/4028747110 >> v1:172.21.15.94:6789/0 conn(0x7f3d740b02d0 legacy=0x7f3d740c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/4028747110 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d74159040 con 0x7f3d74066200 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d6b7fe700 1 --2- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d740afd90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009910 tx=0x7f3d5c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7076453b0880dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d737fe700 1 -- 172.21.15.88:0/4028747110 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c011830 con 0x7f3d74066200 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d737fe700 1 -- 172.21.15.88:0/4028747110 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c011990 con 0x7f3d74066200 2024-09-13T18:05:13.009 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d737fe700 1 -- 172.21.15.88:0/4028747110 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c011d40 con 0x7f3d74066200 2024-09-13T18:05:13.010 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 msgr2=0x7f3d740afd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:13.010 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 --2- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d740afd90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c009910 tx=0x7f3d5c009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:13.010 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- 172.21.15.88:0/4028747110 shutdown_connections 2024-09-13T18:05:13.010 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 --2- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d740afd90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.010 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 --2- 172.21.15.88:0/4028747110 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d740c6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.011 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- 172.21.15.88:0/4028747110 >> 172.21.15.88:0/4028747110 conn(0x7f3d7406ce00 msgr2=0x7f3d7406d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:13.011 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- 172.21.15.88:0/4028747110 shutdown_connections 2024-09-13T18:05:13.011 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.005+0000 7f3d793ee700 1 -- 172.21.15.88:0/4028747110 wait complete. 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 Processor -- start 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- start start 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d74071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d741ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c51e0 con 0x7f3d740b02d0 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74071f40 con 0x7f3d74066200 2024-09-13T18:05:13.012 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740721e0 con 0x7f3d74159b90 2024-09-13T18:05:13.013 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:13.013 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d78bed700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d741ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:13.013 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49120/0 (socket says 172.21.15.88:49120) 2024-09-13T18:05:13.013 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/1727911984 learned_addr learned my addr 172.21.15.88:0/1727911984 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:13.013 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d73fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d74071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:13.014 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 msgr2=0x7f3d741ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:13.014 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d741ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.014 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 msgr2=0x7f3d74071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:13.014 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d74071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.014 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 -- 172.21.15.88:0/1727911984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c009570 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d6b7fe700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000c00 tx=0x7f3d5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c004510 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5c01e070 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d740c4700 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5c003900 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d740c4400 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3d5c01a420 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.009+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3d5c003d60 con 0x7f3d740b02d0 2024-09-13T18:05:13.015 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.013+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d740678b0 con 0x7f3d740b02d0 2024-09-13T18:05:13.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.013+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3d5c020070 con 0x7f3d740b02d0 2024-09-13T18:05:13.046 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:13.045+0000 7fd6d24e72c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:05:13.085 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.081+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d740c1340 con 0x7f3d740b02d0 2024-09-13T18:05:13.086 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.081+0000 7f3d717fa700 1 -- 172.21.15.88:0/1727911984 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3d5c015020 con 0x7f3d740b02d0 2024-09-13T18:05:13.086 INFO:teuthology.misc.health.smithi088.stdout: 2024-09-13T18:05:13.086 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:11.851494+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:13.087 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 msgr2=0x7f3d740c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:13.087 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c000c00 tx=0x7f3d5c004770 comp rx=0 tx=0).stop 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 shutdown_connections 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d74159b90 0x7f3d741ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d740b02d0 0x7f3d740c3880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 --2- 172.21.15.88:0/1727911984 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d74066200 0x7f3d74071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 >> 172.21.15.88:0/1727911984 conn(0x7f3d7406ce00 msgr2=0x7f3d740c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 shutdown_connections 2024-09-13T18:05:13.088 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:13.085+0000 7f3d793ee700 1 -- 172.21.15.88:0/1727911984 wait complete. 2024-09-13T18:05:13.096 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:05:13.374 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:13.369+0000 7fd6d24e72c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:05:13.469 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:13.465+0000 7f2f9e82f2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:05:13.536 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:13.529+0000 7f2f9e82f2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:05:13.554 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:13.549+0000 7fd6d24e72c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:05:13.621 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:13.617+0000 7fd6d24e72c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:05:13.693 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:13.689+0000 7f2f9e82f2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:05:13.761 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:13.753+0000 7f2f9e82f2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:05:13.780 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:13.777+0000 7fd6d24e72c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:05:13.834 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:13.829+0000 7f2f9e82f2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:05:14.158 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:14.153+0000 7f2f9e82f2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:05:14.235 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:14.229+0000 7f2f9e82f2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:05:14.557 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:14.553+0000 7fd6d24e72c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:05:14.623 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:14.621+0000 7fd6d24e72c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:05:14.773 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:14.769+0000 7fd6d24e72c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:05:14.839 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:14.837+0000 7fd6d24e72c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:05:14.913 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:14.909+0000 7fd6d24e72c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:05:14.918 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:14.913+0000 7f2f9e82f2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:05:15.246 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:15.241+0000 7fd6d24e72c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:05:15.318 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:15.313+0000 7fd6d24e72c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:05:15.641 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-09-13T18:05:15.637+0000 7f0712806880 -1 osd.5 0 log_to_monitors true 2024-09-13T18:05:15.870 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-09-13T18:05:15.869+0000 7f2d567f0880 -1 osd.0 0 log_to_monitors true 2024-09-13T18:05:15.961 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:15.957+0000 7f2f853a3700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:05:15.961 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-09-13T18:05:15.957+0000 7f2f853a3700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:05:16.013 INFO:tasks.ceph.mgr.y.smithi088.stderr:2024-09-13T18:05:16.009+0000 7fd6d24e72c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:05:16.045 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-09-13T18:05:16.041+0000 7fc2b03e9880 -1 osd.4 0 log_to_monitors true 2024-09-13T18:05:16.171 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-09-13T18:05:16.165+0000 7fa65376d880 -1 osd.7 0 log_to_monitors true 2024-09-13T18:05:16.188 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-09-13T18:05:16.185+0000 7efcdd2f7880 -1 osd.2 0 log_to_monitors true 2024-09-13T18:05:16.205 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-09-13T18:05:16.201+0000 7efc51a39880 -1 osd.1 0 log_to_monitors true 2024-09-13T18:05:16.333 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-09-13T18:05:16.329+0000 7f2591669880 -1 osd.6 0 log_to_monitors true 2024-09-13T18:05:16.367 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-09-13T18:05:16.365+0000 7fc6e93aa880 -1 osd.3 0 log_to_monitors true 2024-09-13T18:05:17.792 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-09-13T18:05:17.785+0000 7f070e645700 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:05:17.798 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-09-13T18:05:17.793+0000 7f07060f4700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:17.825 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-09-13T18:05:17.821+0000 7f2d5262f700 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:05:17.830 INFO:tasks.ceph.osd.0.smithi088.stderr:2024-09-13T18:05:17.825+0000 7f2d4a0de700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:18.927 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-09-13T18:05:18.921+0000 7f258d4a8700 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:05:18.931 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-09-13T18:05:18.925+0000 7f2584f57700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:18.954 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-09-13T18:05:18.949+0000 7fc2acbaf700 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:05:18.959 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-09-13T18:05:18.953+0000 7fc2a3cd7700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:18.966 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-09-13T18:05:18.961+0000 7fa64f5ac700 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:05:18.971 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-09-13T18:05:18.965+0000 7fa64705b700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:19.014 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-09-13T18:05:19.013+0000 7fc6e5b70700 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:05:19.019 INFO:tasks.ceph.osd.3.smithi088.stderr:2024-09-13T18:05:19.017+0000 7fc6dcc98700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:19.041 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-09-13T18:05:19.037+0000 7efc4e1ff700 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:05:19.046 INFO:tasks.ceph.osd.1.smithi088.stderr:2024-09-13T18:05:19.045+0000 7efc45327700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:19.049 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-09-13T18:05:19.045+0000 7efcd9136700 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:05:19.054 INFO:tasks.ceph.osd.2.smithi088.stderr:2024-09-13T18:05:19.053+0000 7efcd0be5700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:05:19.903 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:20.011 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 Processor -- start 2024-09-13T18:05:20.011 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 -- start start 2024-09-13T18:05:20.016 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06401533b0 0x7f0640159a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.016 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f06400ca430 0x7f06400ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.016 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0640153790 con 0x7f064006b910 2024-09-13T18:05:20.016 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0640159fa0 con 0x7f06401533b0 2024-09-13T18:05:20.016 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064015c6e0 con 0x7f06400ca430 2024-09-13T18:05:20.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f06401533b0 0x7f0640159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063dd9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f064006b910 0x7f06400ce910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40254/0 (socket says 172.21.15.88:40254) 2024-09-13T18:05:20.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063dd9b700 1 -- 172.21.15.88:0/3985931985 learned_addr learned my addr 172.21.15.88:0/3985931985 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:20.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063ed9d700 1 --2- 172.21.15.88:0/3985931985 >> v2:172.21.15.94:3300/0 conn(0x7f06400ca430 0x7f06400ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.017 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 -- 172.21.15.88:0/3985931985 >> v2:172.21.15.94:3300/0 conn(0x7f06400ca430 msgr2=0x7f06400ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 --2- 172.21.15.88:0/3985931985 >> v2:172.21.15.94:3300/0 conn(0x7f06400ca430 0x7f06400ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 -- 172.21.15.88:0/3985931985 >> v1:172.21.15.88:6789/0 conn(0x7f064006b910 legacy=0x7f06400ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063d59a700 1 -- 172.21.15.88:0/3985931985 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3496873855 0 0) 0x7f0640153790 con 0x7f064006b910 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 -- 172.21.15.88:0/3985931985 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064015c9c0 con 0x7f06401533b0 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063e59c700 1 --2- 172.21.15.88:0/3985931985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06401533b0 0x7f0640159a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06400b14a0 tx=0x7f0630009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955f358065e89d68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.018 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063d59a700 1 -- 172.21.15.88:0/3985931985 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011830 con 0x7f06401533b0 2024-09-13T18:05:20.019 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063d59a700 1 -- 172.21.15.88:0/3985931985 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630011990 con 0x7f06401533b0 2024-09-13T18:05:20.019 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063d59a700 1 -- 172.21.15.88:0/3985931985 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630011d20 con 0x7f06401533b0 2024-09-13T18:05:20.019 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 -- 172.21.15.88:0/3985931985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06401533b0 msgr2=0x7f0640159a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.009+0000 7f063f59e700 1 --2- 172.21.15.88:0/3985931985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06401533b0 0x7f0640159a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06400b14a0 tx=0x7f0630009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/3985931985 shutdown_connections 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 --2- 172.21.15.88:0/3985931985 >> v2:172.21.15.94:3300/0 conn(0x7f06400ca430 0x7f06400ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 --2- 172.21.15.88:0/3985931985 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f06401533b0 0x7f0640159a60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/3985931985 >> 172.21.15.88:0/3985931985 conn(0x7f0640066650 msgr2=0x7f064006d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.020 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/3985931985 shutdown_connections 2024-09-13T18:05:20.021 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/3985931985 wait complete. 2024-09-13T18:05:20.021 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 Processor -- start 2024-09-13T18:05:20.021 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- start start 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06400ca430 0x7f06400cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f06401533b0 0x7f0640143260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400b27a0 con 0x7f064006b910 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640145fb0 con 0x7f06400ca430 2024-09-13T18:05:20.026 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06401ef940 con 0x7f06401533b0 2024-09-13T18:05:20.027 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.027 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49170/0 (socket says 172.21.15.88:49170) 2024-09-13T18:05:20.027 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 -- 172.21.15.88:0/1039760251 learned_addr learned my addr 172.21.15.88:0/1039760251 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:20.027 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063dd9b700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06400ca430 0x7f06400cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.027 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063ed9d700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f06401533b0 0x7f0640143260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.028 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 -- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f06401533b0 msgr2=0x7f0640143260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.028 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f06401533b0 0x7f0640143260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.028 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 -- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06400ca430 msgr2=0x7f06400cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.028 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06400ca430 0x7f06400cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.028 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 -- 172.21.15.88:0/1039760251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300094b0 con 0x7f064006b910 2024-09-13T18:05:20.029 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063e59c700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0630014040 tx=0x7f0630004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.029 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300036c0 con 0x7f064006b910 2024-09-13T18:05:20.029 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063001e070 con 0x7f064006b910 2024-09-13T18:05:20.032 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06400cc780 con 0x7f064006b910 2024-09-13T18:05:20.032 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630003a80 con 0x7f064006b910 2024-09-13T18:05:20.033 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.013+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06400cd610 con 0x7f064006b910 2024-09-13T18:05:20.033 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06400c9340 con 0x7f064006b910 2024-09-13T18:05:20.033 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f0630003be0 con 0x7f064006b910 2024-09-13T18:05:20.033 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f062effd700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 0x7f0620068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.033 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4286+0+0 (secure 0 0 0) 0x7f06300848f0 con 0x7f064006b910 2024-09-13T18:05:20.034 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f063dd9b700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 0x7f0620068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.034 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.017+0000 7f063dd9b700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 0x7f0620068b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f064014dfc0 tx=0x7f0634009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.034 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.025+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0630052360 con 0x7f064006b910 2024-09-13T18:05:20.207 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.205+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06400c9000 con 0x7f064006b910 2024-09-13T18:05:20.209 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.205+0000 7f062effd700 1 -- 172.21.15.88:0/1039760251 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12769 (secure 0 0 0) 0x7f0630020090 con 0x7f064006b910 2024-09-13T18:05:20.210 INFO:teuthology.misc.health.smithi088.stdout: 2024-09-13T18:05:20.210 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":15,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:20.051014+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 msgr2=0x7f0620068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 0x7f0620068b60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f064014dfc0 tx=0x7f0634009040 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 msgr2=0x7f064015b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0630014040 tx=0x7f0630004770 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 shutdown_connections 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f06200666a0 0x7f0620068b60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f06401533b0 0x7f0640143260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f06400ca430 0x7f06400cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 --2- 172.21.15.88:0/1039760251 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f064006b910 0x7f064015b730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.212 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 >> 172.21.15.88:0/1039760251 conn(0x7f0640066650 msgr2=0x7f064014e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.213 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 shutdown_connections 2024-09-13T18:05:20.213 INFO:teuthology.misc.health.smithi088.stderr:2024-09-13T18:05:20.209+0000 7f063f59e700 1 -- 172.21.15.88:0/1039760251 wait complete. 2024-09-13T18:05:20.223 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:05:20.223 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:05:20.223 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:05:20.224 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:05:20.226 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:05:20.226 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:05:20.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:05:20.228 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:05:20.229 INFO:tasks.ceph.mds.e:Restarting daemon 2024-09-13T18:05:20.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-09-13T18:05:20.231 INFO:tasks.ceph.mds.e:Started 2024-09-13T18:05:20.231 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:05:20.231 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:05:20.233 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:05:20.233 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:05:20.234 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:05:20.236 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:05:20.236 INFO:tasks.ceph.mds.f:Restarting daemon 2024-09-13T18:05:20.236 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-09-13T18:05:20.238 INFO:tasks.ceph.mds.f:Started 2024-09-13T18:05:20.238 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:05:20.239 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:20.299 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2024-09-13T18:05:20.310 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2024-09-13T18:05:20.312 INFO:tasks.ceph.mds.f.smithi094.stdout:starting mds.f at 2024-09-13T18:05:20.312 INFO:tasks.ceph.mds.b.smithi094.stdout:starting mds.b at 2024-09-13T18:05:20.315 INFO:tasks.ceph.mds.e.smithi088.stdout:starting mds.e at 2024-09-13T18:05:20.317 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2024-09-13T18:05:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 Processor -- start 2024-09-13T18:05:20.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 -- start start 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 0x7f78bc155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 0x7f78bc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0664d0 con 0x7f78bc14ff10 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc06cfb0 con 0x7f78bc0bfff0 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bb59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0704c0 con 0x7f78bc06c030 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78ba59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f78bc14ff10 0x7f78bc0b0720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40278/0 (socket says 172.21.15.88:40278) 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78ba59c700 1 -- 172.21.15.88:0/2022195036 learned_addr learned my addr 172.21.15.88:0/2022195036 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/2022195036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 0x7f78bc155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78bad9d700 1 --2- 172.21.15.88:0/2022195036 >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 0x7f78bc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78b959a700 1 -- 172.21.15.88:0/2022195036 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319233485 0 0) 0x7f78bc0664d0 con 0x7f78bc14ff10 2024-09-13T18:05:20.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.349+0000 7f78b959a700 1 -- 172.21.15.88:0/2022195036 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a40035d0 con 0x7f78bc14ff10 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b9d9b700 1 -- 172.21.15.88:0/2022195036 >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 msgr2=0x7f78bc1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/2022195036 >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 0x7f78bc1563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b9d9b700 1 -- 172.21.15.88:0/2022195036 >> v1:172.21.15.88:6789/0 conn(0x7f78bc14ff10 legacy=0x7f78bc0b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b9d9b700 1 -- 172.21.15.88:0/2022195036 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc06eae0 con 0x7f78bc06c030 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bad9d700 1 --2- 172.21.15.88:0/2022195036 >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 0x7f78bc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:20.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/2022195036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 0x7f78bc155e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009850 tx=0x7f78b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2954edc4e83937a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b959a700 1 -- 172.21.15.88:0/2022195036 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011830 con 0x7f78bc06c030 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b959a700 1 -- 172.21.15.88:0/2022195036 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0011990 con 0x7f78bc06c030 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78b959a700 1 -- 172.21.15.88:0/2022195036 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011d40 con 0x7f78bc06c030 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 -- 172.21.15.88:0/2022195036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 msgr2=0x7f78bc155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 --2- 172.21.15.88:0/2022195036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 0x7f78bc155e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009850 tx=0x7f78b0009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 -- 172.21.15.88:0/2022195036 shutdown_connections 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 --2- 172.21.15.88:0/2022195036 >> v2:172.21.15.94:3300/0 conn(0x7f78bc0bfff0 0x7f78bc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 --2- 172.21.15.88:0/2022195036 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc06c030 0x7f78bc155e70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 -- 172.21.15.88:0/2022195036 >> 172.21.15.88:0/2022195036 conn(0x7f78bc0c7a40 msgr2=0x7f78bc0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 -- 172.21.15.88:0/2022195036 shutdown_connections 2024-09-13T18:05:20.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.353+0000 7f78bb59e700 1 -- 172.21.15.88:0/2022195036 wait complete. 2024-09-13T18:05:20.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 Processor -- start 2024-09-13T18:05:20.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- start start 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78bc0bfff0 0x7f78bc1eed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc14ff10 0x7f78bc0ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc1ef240 con 0x7f78bc06c030 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0af430 con 0x7f78bc0bfff0 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0af6d0 con 0x7f78bc14ff10 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49230/0 (socket says 172.21.15.88:49230) 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 -- 172.21.15.88:0/208716646 learned_addr learned my addr 172.21.15.88:0/208716646 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78bc0bfff0 0x7f78bc1eed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bad9d700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc14ff10 0x7f78bc0ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 -- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc14ff10 msgr2=0x7f78bc0ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc14ff10 0x7f78bc0ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 -- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78bc0bfff0 msgr2=0x7f78bc1eed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78bc0bfff0 0x7f78bc1eed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 -- 172.21.15.88:0/208716646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b4009a70 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78ba59c700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c4d0 tx=0x7f78ac00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac005d90 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0070d0 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b00094b0 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac007480 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.357+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc0af970 con 0x7f78bc06c030 2024-09-13T18:05:20.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.361+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0c8f70 con 0x7f78bc06c030 2024-09-13T18:05:20.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.361+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f78ac0075e0 con 0x7f78bc06c030 2024-09-13T18:05:20.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.361+0000 7f78aaffd700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 0x7f789c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.361+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78ac0831b0 con 0x7f78bc06c030 2024-09-13T18:05:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.361+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 0x7f789c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.365+0000 7f78b9d9b700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 0x7f789c068b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009850 tx=0x7f78b0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.369+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f78ac0508c0 con 0x7f78bc06c030 2024-09-13T18:05:20.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.541+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78bc0c1280 con 0x7f78bc06c030 2024-09-13T18:05:20.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.545+0000 7f78aaffd700 1 -- 172.21.15.88:0/208716646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+12769 (secure 0 0 0) 0x7f78ac053ee0 con 0x7f78bc06c030 2024-09-13T18:05:20.546 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:20.546 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":15,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:20.051014+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 msgr2=0x7f789c068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 0x7f789c068b60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f78b0009850 tx=0x7f78b0008030 comp rx=0 tx=0).stop 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 msgr2=0x7f78bc0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f78ac00c4d0 tx=0x7f78ac00c7e0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 shutdown_connections 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f789c0666a0 0x7f789c068b60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78bc14ff10 0x7f78bc0ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78bc0bfff0 0x7f78bc1eed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 --2- 172.21.15.88:0/208716646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f78bc06c030 0x7f78bc0aeda0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 >> 172.21.15.88:0/208716646 conn(0x7f78bc0c7a40 msgr2=0x7f78bc06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 shutdown_connections 2024-09-13T18:05:20.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.549+0000 7f78bb59e700 1 -- 172.21.15.88:0/208716646 wait complete. 2024-09-13T18:05:20.566 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:20.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:20.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.677+0000 7f7a7d332700 1 Processor -- start 2024-09-13T18:05:20.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.677+0000 7f7a7d332700 1 -- start start 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a78153330 0x7f7a780c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a780cab00 0x7f7a780cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7815a0b0 con 0x7f7a780ca6b0 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a781590e0 con 0x7f7a78153330 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780cafd0 con 0x7f7a780cab00 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a777fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7a780ca6b0 0x7f7a7806eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47270/0 (socket says 172.21.15.88:47270) 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7a78153330 0x7f7a780c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a777fe700 1 -- 172.21.15.88:0/2038133484 learned_addr learned my addr 172.21.15.88:0/2038133484 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7cb31700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a780cab00 0x7f7a780cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a76ffd700 1 -- 172.21.15.88:0/2038133484 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915892587 0 0) 0x7f7a7815a0b0 con 0x7f7a780ca6b0 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a76ffd700 1 -- 172.21.15.88:0/2038133484 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a640035d0 con 0x7f7a780ca6b0 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 -- 172.21.15.88:0/2038133484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a780cab00 msgr2=0x7f7a780cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a780cab00 0x7f7a780cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 -- 172.21.15.88:0/2038133484 >> v1:172.21.15.88:6789/0 conn(0x7f7a780ca6b0 legacy=0x7f7a7806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 -- 172.21.15.88:0/2038133484 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a781592f0 con 0x7f7a78153330 2024-09-13T18:05:20.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a77fff700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a78153330 0x7f7a780c3c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009850 tx=0x7f7a60009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604f8e3b0cc8f917 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a76ffd700 1 -- 172.21.15.88:0/2038133484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60011830 con 0x7f7a78153330 2024-09-13T18:05:20.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a76ffd700 1 -- 172.21.15.88:0/2038133484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a60011990 con 0x7f7a78153330 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a76ffd700 1 -- 172.21.15.88:0/2038133484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a60011d40 con 0x7f7a78153330 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- 172.21.15.88:0/2038133484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a78153330 msgr2=0x7f7a780c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a78153330 0x7f7a780c3c60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7a60009850 tx=0x7f7a60009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- 172.21.15.88:0/2038133484 shutdown_connections 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a780cab00 0x7f7a780cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 --2- 172.21.15.88:0/2038133484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a78153330 0x7f7a780c3c60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- 172.21.15.88:0/2038133484 >> 172.21.15.88:0/2038133484 conn(0x7f7a78071c30 msgr2=0x7f7a78066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- 172.21.15.88:0/2038133484 shutdown_connections 2024-09-13T18:05:20.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.681+0000 7f7a7d332700 1 -- 172.21.15.88:0/2038133484 wait complete. 2024-09-13T18:05:20.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 Processor -- start 2024-09-13T18:05:20.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 -- start start 2024-09-13T18:05:20.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a780ca6b0 0x7f7a781509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a78153330 0x7f7a7815c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a781e90b0 con 0x7f7a780cab00 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a78157d30 con 0x7f7a780ca6b0 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7d332700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7815a660 con 0x7f7a78153330 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52318/0 (socket says 172.21.15.88:52318) 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 -- 172.21.15.88:0/3409108035 learned_addr learned my addr 172.21.15.88:0/3409108035 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a77fff700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a780ca6b0 0x7f7a781509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a7cb31700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a78153330 0x7f7a7815c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 -- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a78153330 msgr2=0x7f7a7815c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a78153330 0x7f7a7815c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 -- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a780ca6b0 msgr2=0x7f7a781509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a780ca6b0 0x7f7a781509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 -- 172.21.15.88:0/3409108035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600094b0 con 0x7f7a780cab00 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.685+0000 7f7a777fe700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c700 tx=0x7f7a6800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68005d90 con 0x7f7a780cab00 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a680070d0 con 0x7f7a780cab00 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a78156d20 con 0x7f7a780cab00 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68007460 con 0x7f7a780cab00 2024-09-13T18:05:20.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a78156f70 con 0x7f7a780cab00 2024-09-13T18:05:20.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a78153710 con 0x7f7a780cab00 2024-09-13T18:05:20.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7f7a680075c0 con 0x7f7a780cab00 2024-09-13T18:05:20.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 0x7f7a58068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:20.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.689+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7a68083130 con 0x7f7a780cab00 2024-09-13T18:05:20.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.693+0000 7f7a77fff700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 0x7f7a58068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:20.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.693+0000 7f7a77fff700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 0x7f7a58068b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a600090b0 tx=0x7f7a60008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:20.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.697+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7a68050960 con 0x7f7a780cab00 2024-09-13T18:05:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.865+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a78156b00 con 0x7f7a780cab00 2024-09-13T18:05:20.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.869+0000 7f7a74ff9700 1 -- 172.21.15.88:0/3409108035 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a68053f80 con 0x7f7a780cab00 2024-09-13T18:05:20.870 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 msgr2=0x7f7a58068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 0x7f7a58068b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7a600090b0 tx=0x7f7a60008030 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 msgr2=0x7f7a780c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c700 tx=0x7f7a6800ca10 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 shutdown_connections 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7a580666d0 0x7f7a58068b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7a78153330 0x7f7a7815c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a780cab00 0x7f7a780c6a10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 --2- 172.21.15.88:0/3409108035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7a780ca6b0 0x7f7a781509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 >> 172.21.15.88:0/3409108035 conn(0x7f7a78071c30 msgr2=0x7f7a781581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:20.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 shutdown_connections 2024-09-13T18:05:20.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.873+0000 7f7a7d332700 1 -- 172.21.15.88:0/3409108035 wait complete. 2024-09-13T18:05:20.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.997+0000 7fd2448d6700 1 Processor -- start 2024-09-13T18:05:21.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.997+0000 7fd2448d6700 1 -- start start 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:20.997+0000 7fd2448d6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2400c89a0 0x7fd240158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24015d3d0 con 0x7fd240071220 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24006f670 con 0x7fd2400c8d80 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24015cb30 con 0x7fd2400c89a0 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2400c89a0 0x7fd240158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd240071220 0x7fd24006fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47284/0 (socket says 172.21.15.88:47284) 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23ffff700 1 -- 172.21.15.88:0/1169436409 learned_addr learned my addr 172.21.15.88:0/1169436409 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:21.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23f7fe700 1 -- 172.21.15.88:0/1169436409 >> v1:172.21.15.94:6789/0 conn(0x7fd2400c8d80 legacy=0x7fd240152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23f7fe700 1 -- 172.21.15.88:0/1169436409 >> v1:172.21.15.88:6789/0 conn(0x7fd240071220 legacy=0x7fd24006fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23f7fe700 1 -- 172.21.15.88:0/1169436409 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24015ce10 con 0x7fd2400c89a0 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23f7fe700 1 --2- 172.21.15.88:0/1169436409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2400c89a0 0x7fd240158e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd230009850 tx=0x7fd230009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874820e083aeb8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23e7fc700 1 -- 172.21.15.88:0/1169436409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230011830 con 0x7fd2400c89a0 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23e7fc700 1 -- 172.21.15.88:0/1169436409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230011990 con 0x7fd2400c89a0 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd23e7fc700 1 -- 172.21.15.88:0/1169436409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230011d20 con 0x7fd2400c89a0 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- 172.21.15.88:0/1169436409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2400c89a0 msgr2=0x7fd240158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 --2- 172.21.15.88:0/1169436409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2400c89a0 0x7fd240158e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd230009850 tx=0x7fd230009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- 172.21.15.88:0/1169436409 shutdown_connections 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 --2- 172.21.15.88:0/1169436409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2400c89a0 0x7fd240158e90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- 172.21.15.88:0/1169436409 >> 172.21.15.88:0/1169436409 conn(0x7fd24006a820 msgr2=0x7fd24006ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- 172.21.15.88:0/1169436409 shutdown_connections 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.001+0000 7fd2448d6700 1 -- 172.21.15.88:0/1169436409 wait complete. 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 Processor -- start 2024-09-13T18:05:21.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- start start 2024-09-13T18:05:21.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:21.008 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2400c89a0 0x7fd2401517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2400c8d80 0x7fd2401ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24015b7d0 con 0x7fd240071220 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24015bab0 con 0x7fd2400c89a0 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd24015bd90 con 0x7fd2400c8d80 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52346/0 (socket says 172.21.15.88:52346) 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 -- 172.21.15.88:0/65655337 learned_addr learned my addr 172.21.15.88:0/65655337 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23effd700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2400c89a0 0x7fd2401517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23ffff700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2400c8d80 0x7fd2401ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 -- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2400c8d80 msgr2=0x7fd2401ef260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2400c8d80 0x7fd2401ef260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 -- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2400c89a0 msgr2=0x7fd2401517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2400c89a0 0x7fd2401517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 -- 172.21.15.88:0/65655337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300094b0 con 0x7fd240071220 2024-09-13T18:05:21.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd23f7fe700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2400cac50 tx=0x7fd230004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:21.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300045d0 con 0x7fd240071220 2024-09-13T18:05:21.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23001f070 con 0x7fd240071220 2024-09-13T18:05:21.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24015c070 con 0x7fd240071220 2024-09-13T18:05:21.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003900 con 0x7fd240071220 2024-09-13T18:05:21.011 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.005+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24015b360 con 0x7fd240071220 2024-09-13T18:05:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2401eef80 con 0x7fd240071220 2024-09-13T18:05:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 86036+0+0 (secure 0 0 0) 0x7fd230003a60 con 0x7fd240071220 2024-09-13T18:05:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd227fff700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 0x7fd22c068b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd230021070 con 0x7fd240071220 2024-09-13T18:05:21.012 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd23effd700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 0x7fd22c068b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:21.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.009+0000 7fd23effd700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 0x7fd22c068b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2400709e0 tx=0x7fd234009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:21.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.017+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2401eef80 con 0x7fd240071220 2024-09-13T18:05:21.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.225+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2401eef80 con 0x7fd240071220 2024-09-13T18:05:21.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.229+0000 7fd227fff700 1 -- 172.21.15.88:0/65655337 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7fd2401eef80 con 0x7fd240071220 2024-09-13T18:05:21.231 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:21.231 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:05:21.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 msgr2=0x7fd22c068b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 0x7fd22c068b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd2400709e0 tx=0x7fd234009040 comp rx=0 tx=0).stop 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 msgr2=0x7fd2401f29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd2400cac50 tx=0x7fd230004770 comp rx=0 tx=0).stop 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 shutdown_connections 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd22c0666a0 0x7fd22c068b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2400c8d80 0x7fd2401ef260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2400c89a0 0x7fd2401517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 --2- 172.21.15.88:0/65655337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd240071220 0x7fd2401f29b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 >> 172.21.15.88:0/65655337 conn(0x7fd24006a820 msgr2=0x7fd2401595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 shutdown_connections 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:21.233+0000 7fd2448d6700 1 -- 172.21.15.88:0/65655337 wait complete. 2024-09-13T18:05:21.237 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 2 2024-09-13T18:05:23.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 Processor -- start 2024-09-13T18:05:23.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 -- start start 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f995006f6a0 0x7f995006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f99500c3e30 0x7f99500c4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995006dce0 con 0x7f9950150b30 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f995006e010 con 0x7f995006f6a0 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994f59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99500c4780 con 0x7f99500c3e30 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f995006f6a0 0x7f995006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994dd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f995006f6a0 0x7f995006fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52358/0 (socket says 172.21.15.88:52358) 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994dd9b700 1 -- 172.21.15.88:0/3042974913 learned_addr learned my addr 172.21.15.88:0/3042974913 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:23.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.369+0000 7f994ed9d700 1 --2- 172.21.15.88:0/3042974913 >> v2:172.21.15.94:3300/0 conn(0x7f99500c3e30 0x7f99500c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994dd9b700 1 -- 172.21.15.88:0/3042974913 >> v2:172.21.15.94:3300/0 conn(0x7f99500c3e30 msgr2=0x7f99500c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994dd9b700 1 --2- 172.21.15.88:0/3042974913 >> v2:172.21.15.94:3300/0 conn(0x7f99500c3e30 0x7f99500c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994dd9b700 1 -- 172.21.15.88:0/3042974913 >> v1:172.21.15.94:6789/0 conn(0x7f9950150b30 legacy=0x7f995006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994dd9b700 1 -- 172.21.15.88:0/3042974913 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995006bcb0 con 0x7f995006f6a0 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994dd9b700 1 --2- 172.21.15.88:0/3042974913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995006f6a0 0x7f995006fb10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f995006bea0 tx=0x7f9940009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f26ddad04d4918 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994d59a700 1 -- 172.21.15.88:0/3042974913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940011830 con 0x7f995006f6a0 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994d59a700 1 -- 172.21.15.88:0/3042974913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9940011990 con 0x7f995006f6a0 2024-09-13T18:05:23.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994d59a700 1 -- 172.21.15.88:0/3042974913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940011d20 con 0x7f995006f6a0 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 -- 172.21.15.88:0/3042974913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995006f6a0 msgr2=0x7f995006fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 --2- 172.21.15.88:0/3042974913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995006f6a0 0x7f995006fb10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f995006bea0 tx=0x7f9940009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 -- 172.21.15.88:0/3042974913 shutdown_connections 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 --2- 172.21.15.88:0/3042974913 >> v2:172.21.15.94:3300/0 conn(0x7f99500c3e30 0x7f99500c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 --2- 172.21.15.88:0/3042974913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f995006f6a0 0x7f995006fb10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 -- 172.21.15.88:0/3042974913 >> 172.21.15.88:0/3042974913 conn(0x7f99500ca720 msgr2=0x7f99500cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 -- 172.21.15.88:0/3042974913 shutdown_connections 2024-09-13T18:05:23.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.373+0000 7f994f59e700 1 -- 172.21.15.88:0/3042974913 wait complete. 2024-09-13T18:05:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 Processor -- start 2024-09-13T18:05:23.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 -- start start 2024-09-13T18:05:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f995006f6a0 0x7f995014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9950150b30 0x7f99501f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c62e0 con 0x7f99500c3e30 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c2630 con 0x7f9950150b30 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99500c9cd0 con 0x7f995006f6a0 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52360/0 (socket says 172.21.15.88:52360) 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994dd9b700 1 -- 172.21.15.88:0/1125121721 learned_addr learned my addr 172.21.15.88:0/1125121721 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994ed9d700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9950150b30 0x7f99501f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.377+0000 7f994e59c700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f995006f6a0 0x7f995014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 -- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f995006f6a0 msgr2=0x7f995014fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f995006f6a0 0x7f995014fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 -- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9950150b30 msgr2=0x7f99501f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9950150b30 0x7f99501f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 -- 172.21.15.88:0/1125121721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940009570 con 0x7f99500c3e30 2024-09-13T18:05:23.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994dd9b700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9940014040 tx=0x7f9940004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99400038c0 con 0x7f99500c3e30 2024-09-13T18:05:23.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994001e070 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9940003c60 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99500c64f0 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99500c2b60 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99501540a0 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f994001a420 con 0x7f99500c3e30 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 0x7f9930068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9940020070 con 0x7f99500c3e30 2024-09-13T18:05:23.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.381+0000 7f994e59c700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 0x7f9930068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.385+0000 7f994e59c700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 0x7f9930068c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9944005150 tx=0x7f9944007ee0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.389+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99501540a0 con 0x7f99500c3e30 2024-09-13T18:05:23.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.593+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99501540a0 con 0x7f99500c3e30 2024-09-13T18:05:23.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.593+0000 7f993effd700 1 -- 172.21.15.88:0/1125121721 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5030 (secure 0 0 0) 0x7f99501540a0 con 0x7f99500c3e30 2024-09-13T18:05:23.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:23.598 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 msgr2=0x7f9930068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 0x7f9930068c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9944005150 tx=0x7f9944007ee0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 msgr2=0x7f9950151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9940014040 tx=0x7f9940004770 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 shutdown_connections 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9930066760 0x7f9930068c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9950150b30 0x7f99501f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99500c3e30 0x7f9950151510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 --2- 172.21.15.88:0/1125121721 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f995006f6a0 0x7f995014fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 >> 172.21.15.88:0/1125121721 conn(0x7f99500ca720 msgr2=0x7f99501486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:23.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 shutdown_connections 2024-09-13T18:05:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.597+0000 7f994f59e700 1 -- 172.21.15.88:0/1125121721 wait complete. 2024-09-13T18:05:23.602 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2024-09-13T18:05:23.613 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:23.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 Processor -- start 2024-09-13T18:05:23.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- start start 2024-09-13T18:05:23.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5c81514d0 0x7fd5c815a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 0x7fd5c80c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c8158070 con 0x7fd5c806e560 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c8157810 con 0x7fd5c81514d0 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80c9bd0 con 0x7fd5c8157c30 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5c81514d0 0x7fd5c815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd5c81514d0 0x7fd5c815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52372/0 (socket says 172.21.15.88:52372) 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 -- 172.21.15.88:0/75292867 learned_addr learned my addr 172.21.15.88:0/75292867 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c77fe700 1 --2- 172.21.15.88:0/75292867 >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 0x7fd5c80c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 -- 172.21.15.88:0/75292867 >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 msgr2=0x7fd5c80c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/75292867 >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 0x7fd5c80c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 -- 172.21.15.88:0/75292867 >> v1:172.21.15.88:6789/0 conn(0x7fd5c806e560 legacy=0x7fd5c80c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 -- 172.21.15.88:0/75292867 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80c87b0 con 0x7fd5c81514d0 2024-09-13T18:05:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c77fe700 1 --2- 172.21.15.88:0/75292867 >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 0x7fd5c80c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:23.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/75292867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c81514d0 0x7fd5c815a720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80cd660 tx=0x7fd5c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8daf91adcc893cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c6ffd700 1 -- 172.21.15.88:0/75292867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000e070 con 0x7fd5c81514d0 2024-09-13T18:05:23.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c6ffd700 1 -- 172.21.15.88:0/75292867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000b9c0 con 0x7fd5c81514d0 2024-09-13T18:05:23.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5c6ffd700 1 -- 172.21.15.88:0/75292867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000bd70 con 0x7fd5c81514d0 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/75292867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c81514d0 msgr2=0x7fd5c815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/75292867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c81514d0 0x7fd5c815a720 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80cd660 tx=0x7fd5c000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/75292867 shutdown_connections 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/75292867 >> v2:172.21.15.94:3300/0 conn(0x7fd5c8157c30 0x7fd5c80c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/75292867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c81514d0 0x7fd5c815a720 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/75292867 >> 172.21.15.88:0/75292867 conn(0x7fd5c8066090 msgr2=0x7fd5c8066470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/75292867 shutdown_connections 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.725+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/75292867 wait complete. 2024-09-13T18:05:23.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 Processor -- start 2024-09-13T18:05:23.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- start start 2024-09-13T18:05:23.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 0x7fd5c81ef770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5c81514d0 0x7fd5c806b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81efcb0 con 0x7fd5c8157c30 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e3940 con 0x7fd5c81514d0 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e1e60 con 0x7fd5c806e560 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52386/0 (socket says 172.21.15.88:52386) 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 -- 172.21.15.88:0/586085789 learned_addr learned my addr 172.21.15.88:0/586085789 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c77fe700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5c81514d0 0x7fd5c806b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 0x7fd5c81ef770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 -- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 msgr2=0x7fd5c81ef770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 0x7fd5c81ef770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 -- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5c81514d0 msgr2=0x7fd5c806b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5c81514d0 0x7fd5c806b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 -- 172.21.15.88:0/586085789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009b30 con 0x7fd5c8157c30 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 0x7fd5c81ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5cce49700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c480 tx=0x7fd5bc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0052d0 con 0x7fd5c8157c30 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc005430 con 0x7fd5c8157c30 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c81e50d0 con 0x7fd5c8157c30 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0055a0 con 0x7fd5c8157c30 2024-09-13T18:05:23.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.729+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c81e4b10 con 0x7fd5c8157c30 2024-09-13T18:05:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c80678f0 con 0x7fd5c8157c30 2024-09-13T18:05:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5bc0038e0 con 0x7fd5c8157c30 2024-09-13T18:05:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5c4ff9700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 0x7fd5b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5bc0832c0 con 0x7fd5c8157c30 2024-09-13T18:05:23.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 0x7fd5b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:23.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.733+0000 7fd5c7fff700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 0x7fd5b4068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b370 tx=0x7fd5c0009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:23.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.741+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd5bc050a10 con 0x7fd5c8157c30 2024-09-13T18:05:23.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.913+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5c80c5470 con 0x7fd5c8157c30 2024-09-13T18:05:23.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5c4ff9700 1 -- 172.21.15.88:0/586085789 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12802 (secure 0 0 0) 0x7fd5bc054030 con 0x7fd5c8157c30 2024-09-13T18:05:23.919 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:23.919 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":16,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:21.053123+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 msgr2=0x7fd5b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 0x7fd5b4068bf0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b370 tx=0x7fd5c0009000 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 msgr2=0x7fd5c81e3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc00c480 tx=0x7fd5bc00c840 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 shutdown_connections 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd5b4066730 0x7fd5b4068bf0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5c8157c30 0x7fd5c81e3dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5c81514d0 0x7fd5c806b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 --2- 172.21.15.88:0/586085789 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5c806e560 0x7fd5c81ef770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:23.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 >> 172.21.15.88:0/586085789 conn(0x7fd5c8066090 msgr2=0x7fd5c8155f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:23.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 shutdown_connections 2024-09-13T18:05:23.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:23.917+0000 7fd5ce8ac700 1 -- 172.21.15.88:0/586085789 wait complete. 2024-09-13T18:05:23.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:23.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.049+0000 7fb82a76d700 1 Processor -- start 2024-09-13T18:05:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.049+0000 7fb82a76d700 1 -- start start 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 0x7fb824155a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb824071b40 con 0x7fb8240c26b0 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb824159000 con 0x7fb8240c54d0 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb824159fd0 con 0x7fb8240c58b0 2024-09-13T18:05:24.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82976b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 0x7fb824155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82976b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 0x7fb824155a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:44064/0 (socket says 172.21.15.88:44064) 2024-09-13T18:05:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:60430/0 (socket says 172.21.15.88:60430) 2024-09-13T18:05:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82976b700 1 -- 172.21.15.88:0/538900868 learned_addr learned my addr 172.21.15.88:0/538900868 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:24.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb829f6c700 1 --1- 172.21.15.88:0/538900868 >> v1:172.21.15.94:6789/0 conn(0x7fb8240c26b0 0x7fb8240c85e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:43170/0 (socket says 172.21.15.88:43170) 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 -- 172.21.15.88:0/538900868 >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 msgr2=0x7fb824155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 --2- 172.21.15.88:0/538900868 >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 0x7fb824155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 -- 172.21.15.88:0/538900868 >> v1:172.21.15.94:6789/0 conn(0x7fb8240c26b0 legacy=0x7fb8240c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 -- 172.21.15.88:0/538900868 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb824159b40 con 0x7fb8240c58b0 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb828f6a700 1 --2- 172.21.15.88:0/538900868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4abfc77bbeb2934 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb81bfff700 1 -- 172.21.15.88:0/538900868 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814005e50 con 0x7fb8240c58b0 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb81bfff700 1 -- 172.21.15.88:0/538900868 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814006030 con 0x7fb8240c58b0 2024-09-13T18:05:24.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb81bfff700 1 -- 172.21.15.88:0/538900868 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8140063c0 con 0x7fb8240c58b0 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- 172.21.15.88:0/538900868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 msgr2=0x7fb824155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 --2- 172.21.15.88:0/538900868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814009b50 comp rx=0 tx=0).stop 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- 172.21.15.88:0/538900868 shutdown_connections 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 --2- 172.21.15.88:0/538900868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c58b0 0x7fb824155f50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 --2- 172.21.15.88:0/538900868 >> v2:172.21.15.94:3300/0 conn(0x7fb8240c54d0 0x7fb824155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- 172.21.15.88:0/538900868 >> 172.21.15.88:0/538900868 conn(0x7fb82406a640 msgr2=0x7fb82406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- 172.21.15.88:0/538900868 shutdown_connections 2024-09-13T18:05:24.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 -- 172.21.15.88:0/538900868 wait complete. 2024-09-13T18:05:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.053+0000 7fb82a76d700 1 Processor -- start 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- start start 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c54d0 0x7fb82414a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 0x7fb8241f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82414b0a0 con 0x7fb8240c26b0 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824153880 con 0x7fb8240c58b0 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82414a200 con 0x7fb8240c54d0 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52400/0 (socket says 172.21.15.88:52400) 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 -- 172.21.15.88:0/993621656 learned_addr learned my addr 172.21.15.88:0/993621656 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:24.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb829f6c700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 0x7fb8241f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb828f6a700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c54d0 0x7fb82414a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 -- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c54d0 msgr2=0x7fb82414a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c54d0 0x7fb82414a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 -- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 msgr2=0x7fb8241f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 0x7fb8241f1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 -- 172.21.15.88:0/993621656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814009450 con 0x7fb8240c26b0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb829f6c700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 0x7fb8241f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82976b700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009d90 tx=0x7fb81c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00cbb0 con 0x7fb8240c26b0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00f040 con 0x7fb8240c26b0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c014480 con 0x7fb8240c26b0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82414a4e0 con 0x7fb8240c26b0 2024-09-13T18:05:24.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb824153ad0 con 0x7fb8240c26b0 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.057+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240c7860 con 0x7fb8240c26b0 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.061+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb81c0145e0 con 0x7fb8240c26b0 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.061+0000 7fb819ffb700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 0x7fb808068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.061+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb81c0843d0 con 0x7fb8240c26b0 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.061+0000 7fb828f6a700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 0x7fb808068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.061+0000 7fb828f6a700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 0x7fb808068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.069+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb81c051a10 con 0x7fb8240c26b0 2024-09-13T18:05:24.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.240+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8240ca8c0 con 0x7fb8240c26b0 2024-09-13T18:05:24.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.240+0000 7fb819ffb700 1 -- 172.21.15.88:0/993621656 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb81c055030 con 0x7fb8240c26b0 2024-09-13T18:05:24.245 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 msgr2=0x7fb808068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 0x7fb808068bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb814009840 tx=0x7fb814008070 comp rx=0 tx=0).stop 2024-09-13T18:05:24.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 msgr2=0x7fb824156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009d90 tx=0x7fb81c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 shutdown_connections 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb808066730 0x7fb808068bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8240c54d0 0x7fb82414a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8240c58b0 0x7fb8241f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 --2- 172.21.15.88:0/993621656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8240c26b0 0x7fb824156ad0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 >> 172.21.15.88:0/993621656 conn(0x7fb82406a640 msgr2=0x7fb82406db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 shutdown_connections 2024-09-13T18:05:24.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.244+0000 7fb82a76d700 1 -- 172.21.15.88:0/993621656 wait complete. 2024-09-13T18:05:24.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:05:24.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 Processor -- start 2024-09-13T18:05:24.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 -- start start 2024-09-13T18:05:24.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73080c3f20 0x7f730815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f73080c39d0 0x7f7308159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7308153780 con 0x7f73081533a0 2024-09-13T18:05:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080b20d0 con 0x7f73080c3f20 2024-09-13T18:05:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730c97a700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73080c9d20 con 0x7f73080c39d0 2024-09-13T18:05:24.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73080c3f20 0x7f730815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f73080c3f20 0x7f730815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52412/0 (socket says 172.21.15.88:52412) 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.364+0000 7f730659c700 1 -- 172.21.15.88:0/2883842826 learned_addr learned my addr 172.21.15.88:0/2883842826 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730759e700 1 --2- 172.21.15.88:0/2883842826 >> v2:172.21.15.94:3300/0 conn(0x7f73080c39d0 0x7f7308159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730659c700 1 -- 172.21.15.88:0/2883842826 >> v2:172.21.15.94:3300/0 conn(0x7f73080c39d0 msgr2=0x7f7308159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730659c700 1 --2- 172.21.15.88:0/2883842826 >> v2:172.21.15.94:3300/0 conn(0x7f73080c39d0 0x7f7308159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730659c700 1 -- 172.21.15.88:0/2883842826 >> v1:172.21.15.94:6789/0 conn(0x7f73081533a0 legacy=0x7f73080cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730659c700 1 -- 172.21.15.88:0/2883842826 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73080c9760 con 0x7f73080c3f20 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730659c700 1 --2- 172.21.15.88:0/2883842826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815cf50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73080c8f50 tx=0x7f72f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ee76dc93c3958c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f7305d9b700 1 -- 172.21.15.88:0/2883842826 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800e070 con 0x7f73080c3f20 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f7305d9b700 1 -- 172.21.15.88:0/2883842826 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8003a40 con 0x7f73080c3f20 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f7305d9b700 1 -- 172.21.15.88:0/2883842826 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003df0 con 0x7f73080c3f20 2024-09-13T18:05:24.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- 172.21.15.88:0/2883842826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 msgr2=0x7f730815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 --2- 172.21.15.88:0/2883842826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815cf50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73080c8f50 tx=0x7f72f800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- 172.21.15.88:0/2883842826 shutdown_connections 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 --2- 172.21.15.88:0/2883842826 >> v2:172.21.15.94:3300/0 conn(0x7f73080c39d0 0x7f7308159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 --2- 172.21.15.88:0/2883842826 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815cf50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- 172.21.15.88:0/2883842826 >> 172.21.15.88:0/2883842826 conn(0x7f7308071800 msgr2=0x7f7308071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:24.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- 172.21.15.88:0/2883842826 shutdown_connections 2024-09-13T18:05:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- 172.21.15.88:0/2883842826 wait complete. 2024-09-13T18:05:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 Processor -- start 2024-09-13T18:05:24.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.368+0000 7f730c97a700 1 -- start start 2024-09-13T18:05:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73080c39d0 0x7f7308158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73081533a0 0x7f730815a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73081f2590 con 0x7f73080c3f20 2024-09-13T18:05:24.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c62a0 con 0x7f73080c39d0 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730814da40 con 0x7f73081533a0 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52414/0 (socket says 172.21.15.88:52414) 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 -- 172.21.15.88:0/3505340310 learned_addr learned my addr 172.21.15.88:0/3505340310 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f7306d9d700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73080c39d0 0x7f7308158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730759e700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73081533a0 0x7f730815a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 -- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73081533a0 msgr2=0x7f730815a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73081533a0 0x7f730815a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 -- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73080c39d0 msgr2=0x7f7308158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73080c39d0 0x7f7308158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 -- 172.21.15.88:0/3505340310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8009b30 con 0x7f73080c3f20 2024-09-13T18:05:24.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730659c700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000f80 tx=0x7f72f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004500 con 0x7f73080c3f20 2024-09-13T18:05:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8004660 con 0x7f73080c3f20 2024-09-13T18:05:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73081f1910 con 0x7f73080c3f20 2024-09-13T18:05:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8012430 con 0x7f73080c3f20 2024-09-13T18:05:24.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73081f1ed0 con 0x7f73080c3f20 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730815cf50 con 0x7f73080c3f20 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.372+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72f8012590 con 0x7f73080c3f20 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.376+0000 7f72ef7fe700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 0x7f72f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.376+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f72f8084fd0 con 0x7f73080c3f20 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.376+0000 7f7306d9d700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 0x7f72f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.376+0000 7f7306d9d700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 0x7f72f4068bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009890 tx=0x7f72fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.380+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72f8052600 con 0x7f73080c3f20 2024-09-13T18:05:24.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.552+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f73080ca330 con 0x7f73080c3f20 2024-09-13T18:05:24.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.552+0000 7f72ef7fe700 1 -- 172.21.15.88:0/3505340310 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f72f8017090 con 0x7f73080c3f20 2024-09-13T18:05:24.557 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:24.557 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2024-09-13T18:05:24.558 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:24.558 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2024-09-13T18:05:24.558 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2024-09-13T18:05:24.558 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:24.558 INFO:teuthology.orchestra.run.smithi088.stdout:] 2024-09-13T18:05:24.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 msgr2=0x7f72f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 0x7f72f4068bf0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009890 tx=0x7f72fc008040 comp rx=0 tx=0).stop 2024-09-13T18:05:24.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 msgr2=0x7f730815a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000f80 tx=0x7f72f8004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 shutdown_connections 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f72f4066730 0x7f72f4068bf0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f73081533a0 0x7f730815a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f73080c3f20 0x7f730815a110 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 --2- 172.21.15.88:0/3505340310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f73080c39d0 0x7f7308158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 >> 172.21.15.88:0/3505340310 conn(0x7f7308071800 msgr2=0x7f73081521e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 shutdown_connections 2024-09-13T18:05:24.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.556+0000 7f730c97a700 1 -- 172.21.15.88:0/3505340310 wait complete. 2024-09-13T18:05:24.572 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:05:24.572 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:05:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.684+0000 7fc0b897f700 1 Processor -- start 2024-09-13T18:05:24.689 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.684+0000 7fc0b897f700 1 -- start start 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 0x7fc0b406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0b4159490 0x7fc0b4159940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b4159e80 con 0x7fc0b40cad70 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b40b2290 con 0x7fc0b4159490 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4159060 con 0x7fc0b4153330 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0b40cad70 0x7fc0b406eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47290/0 (socket says 172.21.15.88:47290) 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b259c700 1 -- 172.21.15.88:0/3668448521 learned_addr learned my addr 172.21.15.88:0/3668448521 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:24.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b2d9d700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 0x7fc0b406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 --2- 172.21.15.88:0/3668448521 >> v2:172.21.15.94:3300/0 conn(0x7fc0b4159490 0x7fc0b4159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b1d9b700 1 -- 172.21.15.88:0/3668448521 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729048244 0 0) 0x7fc0b4159e80 con 0x7fc0b40cad70 2024-09-13T18:05:24.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b1d9b700 1 -- 172.21.15.88:0/3668448521 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a00035d0 con 0x7fc0b40cad70 2024-09-13T18:05:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 -- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 msgr2=0x7fc0b406fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 0x7fc0b406fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 -- 172.21.15.88:0/3668448521 >> v1:172.21.15.88:6789/0 conn(0x7fc0b40cad70 legacy=0x7fc0b406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 -- 172.21.15.88:0/3668448521 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b415c7f0 con 0x7fc0b4159490 2024-09-13T18:05:24.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b2d9d700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 0x7fc0b406fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b359e700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b4159940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009850 tx=0x7fc0ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ba140df60daf6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b1d9b700 1 -- 172.21.15.88:0/3668448521 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac011830 con 0x7fc0b4159490 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b1d9b700 1 -- 172.21.15.88:0/3668448521 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac011990 con 0x7fc0b4159490 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b1d9b700 1 -- 172.21.15.88:0/3668448521 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac011d40 con 0x7fc0b4159490 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 msgr2=0x7fc0b4159940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b4159940 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac009850 tx=0x7fc0ac009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- 172.21.15.88:0/3668448521 shutdown_connections 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b4159940 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 --2- 172.21.15.88:0/3668448521 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b4153330 0x7fc0b406fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- 172.21.15.88:0/3668448521 >> 172.21.15.88:0/3668448521 conn(0x7fc0b40cefc0 msgr2=0x7fc0b40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- 172.21.15.88:0/3668448521 shutdown_connections 2024-09-13T18:05:24.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.688+0000 7fc0b897f700 1 -- 172.21.15.88:0/3668448521 wait complete. 2024-09-13T18:05:24.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 Processor -- start 2024-09-13T18:05:24.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- start start 2024-09-13T18:05:24.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b40cad70 0x7fc0b41f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b41585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41437f0 con 0x7fc0b4153330 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41f2900 con 0x7fc0b4159490 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41efbd0 con 0x7fc0b40cad70 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52422/0 (socket says 172.21.15.88:52422) 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 -- 172.21.15.88:0/713003842 learned_addr learned my addr 172.21.15.88:0/713003842 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b2d9d700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b40cad70 0x7fc0b41f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b359e700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b41585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 -- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b40cad70 msgr2=0x7fc0b41f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b40cad70 0x7fc0b41f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 -- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 msgr2=0x7fc0b41585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:24.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b41585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 -- 172.21.15.88:0/713003842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a4009a70 con 0x7fc0b4153330 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b359e700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b41585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b259c700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc09c005930 tx=0x7fc09c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c005d90 con 0x7fc0b4153330 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ac0094b0 con 0x7fc0b4153330 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c0070d0 con 0x7fc0b4153330 2024-09-13T18:05:24.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c007480 con 0x7fc0b4153330 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.692+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b41f2ba0 con 0x7fc0b4153330 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b40cbd00 con 0x7fc0b4153330 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc09c0075e0 con 0x7fc0b4153330 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0ab7fe700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 0x7fc094068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc09c0834a0 con 0x7fc0b4153330 2024-09-13T18:05:24.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0b2d9d700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 0x7fc094068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:24.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.696+0000 7fc0b2d9d700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 0x7fc094068bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4007600 tx=0x7fc0a400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:24.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.704+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc09c050a50 con 0x7fc0b4153330 2024-09-13T18:05:24.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:24.876+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc0b40c9ec0 con 0x7fc0b4153330 2024-09-13T18:05:25.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.088+0000 7fc0ab7fe700 1 -- 172.21.15.88:0/713003842 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc09c054070 con 0x7fc0b4153330 2024-09-13T18:05:25.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 msgr2=0x7fc094068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 0x7fc094068bf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4007600 tx=0x7fc0a400b040 comp rx=0 tx=0).stop 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 msgr2=0x7fc0b4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc09c005930 tx=0x7fc09c00ca90 comp rx=0 tx=0).stop 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 shutdown_connections 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc094066730 0x7fc094068bf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0b4159490 0x7fc0b41585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0b4153330 0x7fc0b4151c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 --2- 172.21.15.88:0/713003842 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc0b40cad70 0x7fc0b41f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 >> 172.21.15.88:0/713003842 conn(0x7fc0b40cefc0 msgr2=0x7fc0b4156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 shutdown_connections 2024-09-13T18:05:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.100+0000 7fc0b897f700 1 -- 172.21.15.88:0/713003842 wait complete. 2024-09-13T18:05:25.106 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2024-09-13T18:05:25.117 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:05:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.232+0000 7fb6312e7700 1 Processor -- start 2024-09-13T18:05:25.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.232+0000 7fb6312e7700 1 -- start start 2024-09-13T18:05:25.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb6312e7700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb62c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb6312e7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c15a0b0 con 0x7fb62c0caad0 2024-09-13T18:05:25.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb6312e7700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c0cafd0 con 0x7fb62c0ca6b0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb6312e7700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1590e0 con 0x7fb62c153330 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb630ae6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb62c0caad0 0x7fb62c0cb410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47300/0 (socket says 172.21.15.88:47300) 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb630ae6700 1 -- 172.21.15.88:0/2828191668 learned_addr learned my addr 172.21.15.88:0/2828191668 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb62c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015991671 0 0) 0x7fb62c15a0b0 con 0x7fb62c0caad0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6180035d0 con 0x7fb62c0caad0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2084014275 0 0) 0x7fb62c0cafd0 con 0x7fb62c0ca6b0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb62c15a0b0 con 0x7fb62c0ca6b0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333449420 0 0) 0x7fb6180035d0 con 0x7fb62c0caad0 2024-09-13T18:05:25.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 msgr2=0x7fb62c0c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb62c0c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 >> v1:172.21.15.94:6789/0 conn(0x7fb62c0ca6b0 legacy=0x7fb62c06eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c1592f0 con 0x7fb62c0caad0 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fb6240019f0 con 0x7fb62c0caad0 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb62c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 >> v1:172.21.15.88:6789/0 conn(0x7fb62c0caad0 legacy=0x7fb62c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb618003be0 0x7fb618003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb618004870 0x7fb618004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb618005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1590e0 con 0x7fb618003be0 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb618003be0 0x7fb618003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800ba30 con 0x7fb618004870 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61800bbc0 con 0x7fb62c153330 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb6237fe700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb618004870 0x7fb618004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb630ae6700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb618005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 -- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 msgr2=0x7fb618005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c153330 0x7fb618005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 -- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb618004870 msgr2=0x7fb618004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb618004870 0x7fb618004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.236+0000 7fb62bfff700 1 -- 172.21.15.88:0/2828191668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140094b0 con 0x7fb618003be0 2024-09-13T18:05:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb62bfff700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb618003be0 0x7fb618003fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb614009d70 tx=0x7fb6180058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27612248169f6c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400e9a0 con 0x7fb618003be0 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb61400eb00 con 0x7fb618003be0 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb62b7fe700 1 -- 172.21.15.88:0/2828191668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb61400ee70 con 0x7fb618003be0 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- 172.21.15.88:0/2828191668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb618003be0 msgr2=0x7fb618003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 --2- 172.21.15.88:0/2828191668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb618003be0 0x7fb618003fc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb614009d70 tx=0x7fb6180058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb630ae6700 1 -- 172.21.15.88:0/2828191668 reap_dead start 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- 172.21.15.88:0/2828191668 shutdown_connections 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- 172.21.15.88:0/2828191668 >> 172.21.15.88:0/2828191668 conn(0x7fb62c071c30 msgr2=0x7fb62c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- 172.21.15.88:0/2828191668 shutdown_connections 2024-09-13T18:05:25.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- 172.21.15.88:0/2828191668 wait complete. 2024-09-13T18:05:25.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 Processor -- start 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- start start 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb618003be0 0x7fb62c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c0cf530 0x7fb62c1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0cdbc0 con 0x7fb62c1f2a50 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c0cee70 con 0x7fb62c0cf530 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.240+0000 7fb6312e7700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1f2ed0 con 0x7fb618003be0 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52440/0 (socket says 172.21.15.88:52440) 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 -- 172.21.15.88:0/4283835848 learned_addr learned my addr 172.21.15.88:0/4283835848 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6237fe700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c0cf530 0x7fb62c1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb62bfff700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb618003be0 0x7fb62c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 -- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb618003be0 msgr2=0x7fb62c150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb618003be0 0x7fb62c150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 -- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c0cf530 msgr2=0x7fb62c1f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c0cf530 0x7fb62c1f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 -- 172.21.15.88:0/4283835848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c14eff0 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb630ae6700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb62c15d770 tx=0x7fb624005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624008800 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb624008980 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c14ed10 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6240143f0 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c0ceb00 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c0cec90 con 0x7fb62c1f2a50 2024-09-13T18:05:25.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb624014550 con 0x7fb62c1f2a50 2024-09-13T18:05:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.244+0000 7fb6297fa700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 0x7fb60c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.248+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fb6240845f0 con 0x7fb62c1f2a50 2024-09-13T18:05:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.248+0000 7fb62bfff700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 0x7fb60c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:25.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.248+0000 7fb62bfff700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 0x7fb60c068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6140090b0 tx=0x7fb614008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:25.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.252+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb624051b50 con 0x7fb62c1f2a50 2024-09-13T18:05:25.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:25.420+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb62c153710 con 0x7fb62c1f2a50 2024-09-13T18:05:26.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.096+0000 7fb6297fa700 1 -- 172.21.15.88:0/4283835848 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb624055170 con 0x7fb62c1f2a50 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 msgr2=0x7fb60c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 0x7fb60c068bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb6140090b0 tx=0x7fb614008030 comp rx=0 tx=0).stop 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 msgr2=0x7fb62c149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb62c15d770 tx=0x7fb624005ef0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 shutdown_connections 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb60c066730 0x7fb60c068bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb62c1f2a50 0x7fb62c149240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c0cf530 0x7fb62c1f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 --2- 172.21.15.88:0/4283835848 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb618003be0 0x7fb62c150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 >> 172.21.15.88:0/4283835848 conn(0x7fb62c071c30 msgr2=0x7fb62c156d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 shutdown_connections 2024-09-13T18:05:26.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.108+0000 7fb6312e7700 1 -- 172.21.15.88:0/4283835848 wait complete. 2024-09-13T18:05:26.116 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2024-09-13T18:05:26.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:05:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 Processor -- start 2024-09-13T18:05:26.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 -- start start 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8af00e6320 0x7f8af004bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af0005b00 con 0x7f8af00460c0 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af00e3560 con 0x7f8af0045ce0 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af0035710 con 0x7f8af00e6320 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af759e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8af00460c0 0x7f8af00dc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47316/0 (socket says 172.21.15.88:47316) 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af759e700 1 -- 172.21.15.88:0/1756428031 learned_addr learned my addr 172.21.15.88:0/1756428031 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:26.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af6d9d700 1 --2- 172.21.15.88:0/1756428031 >> v2:172.21.15.88:3300/0 conn(0x7f8af00e6320 0x7f8af004bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af6d9d700 1 -- 172.21.15.88:0/1756428031 >> v1:172.21.15.94:6789/0 conn(0x7f8af0045ce0 legacy=0x7f8af00e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af6d9d700 1 -- 172.21.15.88:0/1756428031 >> v1:172.21.15.88:6789/0 conn(0x7f8af00460c0 legacy=0x7f8af00dc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af5d9b700 1 -- 172.21.15.88:0/1756428031 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222734415 0 0) 0x7f8af0005b00 con 0x7f8af00460c0 2024-09-13T18:05:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af6d9d700 1 -- 172.21.15.88:0/1756428031 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af004c510 con 0x7f8af00e6320 2024-09-13T18:05:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af6d9d700 1 --2- 172.21.15.88:0/1756428031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af00e6320 0x7f8af004bfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009850 tx=0x7f8aec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9dff2b554276d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af5d9b700 1 -- 172.21.15.88:0/1756428031 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011830 con 0x7f8af00e6320 2024-09-13T18:05:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af5d9b700 1 -- 172.21.15.88:0/1756428031 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec011990 con 0x7f8af00e6320 2024-09-13T18:05:26.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8af5d9b700 1 -- 172.21.15.88:0/1756428031 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec011d20 con 0x7f8af00e6320 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 -- 172.21.15.88:0/1756428031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af00e6320 msgr2=0x7f8af004bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.244+0000 7f8afc867700 1 --2- 172.21.15.88:0/1756428031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af00e6320 0x7f8af004bfd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009850 tx=0x7f8aec009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- 172.21.15.88:0/1756428031 shutdown_connections 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 --2- 172.21.15.88:0/1756428031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af00e6320 0x7f8af004bfd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- 172.21.15.88:0/1756428031 >> 172.21.15.88:0/1756428031 conn(0x7f8af004fd00 msgr2=0x7f8af0050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- 172.21.15.88:0/1756428031 shutdown_connections 2024-09-13T18:05:26.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- 172.21.15.88:0/1756428031 wait complete. 2024-09-13T18:05:26.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 Processor -- start 2024-09-13T18:05:26.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- start start 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8af0045ce0 0x7f8af00ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8af00460c0 0x7f8af0179110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0178a20 con 0x7f8af0050830 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af00483f0 con 0x7f8af00460c0 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8afc867700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0178c10 con 0x7f8af0045ce0 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52462/0 (socket says 172.21.15.88:52462) 2024-09-13T18:05:26.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 -- 172.21.15.88:0/2275892996 learned_addr learned my addr 172.21.15.88:0/2275892996 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af6d9d700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8af0045ce0 0x7f8af00ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af659c700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8af00460c0 0x7f8af0179110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 -- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8af0045ce0 msgr2=0x7f8af00ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8af0045ce0 0x7f8af00ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 -- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8af00460c0 msgr2=0x7f8af0179110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8af00460c0 0x7f8af0179110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.248+0000 7f8af759e700 1 -- 172.21.15.88:0/2275892996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec0094b0 con 0x7f8af0050830 2024-09-13T18:05:26.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8af759e700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8af802ce60 tx=0x7f8af8074690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8068610 con 0x7f8af0050830 2024-09-13T18:05:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af804e870 con 0x7f8af0050830 2024-09-13T18:05:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af017cc40 con 0x7f8af0050830 2024-09-13T18:05:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8067d00 con 0x7f8af0050830 2024-09-13T18:05:26.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af0047480 con 0x7f8af0050830 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af0178dd0 con 0x7f8af0050830 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8af8072140 con 0x7f8af0050830 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 0x7f8ae4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8af80fe580 con 0x7f8af0050830 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.252+0000 7f8af6d9d700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 0x7f8ae4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.256+0000 7f8af6d9d700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 0x7f8ae4068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d5c0 tx=0x7f8aec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.260+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8af80cb950 con 0x7f8af0050830 2024-09-13T18:05:26.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.460+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8af0047670 con 0x7f8af0050830 2024-09-13T18:05:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.472+0000 7f8adf7fe700 1 -- 172.21.15.88:0/2275892996 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8af809ce80 con 0x7f8af0050830 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 msgr2=0x7f8ae4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 0x7f8ae4068bf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8af000d5c0 tx=0x7f8aec008030 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 msgr2=0x7f8af00dbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8af802ce60 tx=0x7f8af8074690 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 shutdown_connections 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8ae4066730 0x7f8ae4068bf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8af0050830 0x7f8af00dbe70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8af00460c0 0x7f8af0179110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 --2- 172.21.15.88:0/2275892996 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8af0045ce0 0x7f8af00ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 >> 172.21.15.88:0/2275892996 conn(0x7f8af004fd00 msgr2=0x7f8af004ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 shutdown_connections 2024-09-13T18:05:26.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.480+0000 7f8afc867700 1 -- 172.21.15.88:0/2275892996 wait complete. 2024-09-13T18:05:26.494 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:05:26.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.604+0000 7fc218c67700 1 Processor -- start 2024-09-13T18:05:26.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc218c67700 1 -- start start 2024-09-13T18:05:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc218c67700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc21406f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc218c67700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc214156ec0 con 0x7fc21406fbe0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc218c67700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21406bcb0 con 0x7fc2140c3e30 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc218c67700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc214156c20 con 0x7fc214150ac0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc21406fbe0 0x7fc214157350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47330/0 (socket says 172.21.15.88:47330) 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 -- 172.21.15.88:0/7606696 learned_addr learned my addr 172.21.15.88:0/7606696 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc2137fe700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc21406f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109107084 0 0) 0x7fc214156ec0 con 0x7fc21406fbe0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2000035d0 con 0x7fc21406fbe0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 381589706 0 0) 0x7fc2000035d0 con 0x7fc21406fbe0 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 msgr2=0x7fc21406f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc21406f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 >> v1:172.21.15.94:6789/0 conn(0x7fc2140c3e30 legacy=0x7fc2141615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21406bf50 con 0x7fc21406fbe0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fc1fc001670 con 0x7fc21406fbe0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 >> v1:172.21.15.88:6789/0 conn(0x7fc21406fbe0 legacy=0x7fc214157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc200003a50 0x7fc200003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc200004870 0x7fc200004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc200005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc214156c20 con 0x7fc200004870 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc20000bb70 con 0x7fc200003a50 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc20000bd30 con 0x7fc214150ac0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc200004870 0x7fc200004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc213fff700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc200005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc2137fe700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc200003a50 0x7fc200003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 -- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 msgr2=0x7fc200005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc214150ac0 0x7fc200005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 -- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc200003a50 msgr2=0x7fc200003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc200003a50 0x7fc200003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 -- 172.21.15.88:0/7606696 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2000035d0 con 0x7fc200004870 2024-09-13T18:05:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc20affd700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc200004870 0x7fc200004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc21406d3b0 tx=0x7fc2000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ce4df31f9474c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc007c30 con 0x7fc200004870 2024-09-13T18:05:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc00ce20 con 0x7fc200004870 2024-09-13T18:05:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.608+0000 7fc212ffd700 1 -- 172.21.15.88:0/7606696 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc005bc0 con 0x7fc200004870 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- 172.21.15.88:0/7606696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc200004870 msgr2=0x7fc200004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 --2- 172.21.15.88:0/7606696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc200004870 0x7fc200004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc21406d3b0 tx=0x7fc2000058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc213fff700 1 -- 172.21.15.88:0/7606696 reap_dead start 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- 172.21.15.88:0/7606696 shutdown_connections 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- 172.21.15.88:0/7606696 >> 172.21.15.88:0/7606696 conn(0x7fc2140ca720 msgr2=0x7fc2140cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- 172.21.15.88:0/7606696 shutdown_connections 2024-09-13T18:05:26.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- 172.21.15.88:0/7606696 wait complete. 2024-09-13T18:05:26.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 Processor -- start 2024-09-13T18:05:26.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- start start 2024-09-13T18:05:26.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc200004870 0x7fc2140c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc214157de0 0x7fc214149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141f2a20 con 0x7fc214149f70 2024-09-13T18:05:26.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141f2740 con 0x7fc214157de0 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc218c67700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2141583a0 con 0x7fc200004870 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc20affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc20affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52484/0 (socket says 172.21.15.88:52484) 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc20affd700 1 -- 172.21.15.88:0/3062024892 learned_addr learned my addr 172.21.15.88:0/3062024892 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc2137fe700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc200004870 0x7fc2140c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.612+0000 7fc213fff700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc214157de0 0x7fc214149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 -- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc200004870 msgr2=0x7fc2140c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc200004870 0x7fc2140c3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 -- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc214157de0 msgr2=0x7fc214149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc214157de0 0x7fc214149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 -- 172.21.15.88:0/3062024892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214158680 con 0x7fc214149f70 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc20affd700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2000047d0 tx=0x7fc1fc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc004ca0 con 0x7fc214149f70 2024-09-13T18:05:26.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1fc004e20 con 0x7fc214149f70 2024-09-13T18:05:26.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc214158960 con 0x7fc214149f70 2024-09-13T18:05:26.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc007310 con 0x7fc214149f70 2024-09-13T18:05:26.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2140c3550 con 0x7fc214149f70 2024-09-13T18:05:26.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21404e7f0 con 0x7fc214149f70 2024-09-13T18:05:26.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1fc007470 con 0x7fc214149f70 2024-09-13T18:05:26.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 0x7fc1f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1fc085950 con 0x7fc214149f70 2024-09-13T18:05:26.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.616+0000 7fc2137fe700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 0x7fc1f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.620+0000 7fc2137fe700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 0x7fc1f4068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc204009ac0 tx=0x7fc204008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.628+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1fc052d50 con 0x7fc214149f70 2024-09-13T18:05:26.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.800+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2141581c0 con 0x7fc214149f70 2024-09-13T18:05:26.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc210ff9700 1 -- 172.21.15.88:0/3062024892 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fc1fc017090 con 0x7fc214149f70 2024-09-13T18:05:26.807 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:26.807 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:26.465046+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:26.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 msgr2=0x7fc1f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 0x7fc1f4068bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc204009ac0 tx=0x7fc204008040 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 msgr2=0x7fc214149240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc2000047d0 tx=0x7fc1fc001a00 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 shutdown_connections 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1f4066730 0x7fc1f4068bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc214157de0 0x7fc214149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc214149f70 0x7fc214149240 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 --2- 172.21.15.88:0/3062024892 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc200004870 0x7fc2140c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 >> 172.21.15.88:0/3062024892 conn(0x7fc2140ca720 msgr2=0x7fc214154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 shutdown_connections 2024-09-13T18:05:26.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.804+0000 7fc218c67700 1 -- 172.21.15.88:0/3062024892 wait complete. 2024-09-13T18:05:26.822 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 Processor -- start 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 -- start start 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb60806f6a0 0x7fb60806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60806dce0 con 0x7fb608150b30 2024-09-13T18:05:26.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60806e010 con 0x7fb60806f6a0 2024-09-13T18:05:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60dc52700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60806d140 con 0x7fb6080c3e30 2024-09-13T18:05:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60d451700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60d451700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:60532/0 (socket says 172.21.15.88:60532) 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb60d451700 1 -- 172.21.15.88:0/3887732371 learned_addr learned my addr 172.21.15.88:0/3887732371 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.932+0000 7fb607fff700 1 --2- 172.21.15.88:0/3887732371 >> v2:172.21.15.94:3300/0 conn(0x7fb60806f6a0 0x7fb60806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60d451700 1 -- 172.21.15.88:0/3887732371 >> v2:172.21.15.94:3300/0 conn(0x7fb60806f6a0 msgr2=0x7fb60806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60d451700 1 --2- 172.21.15.88:0/3887732371 >> v2:172.21.15.94:3300/0 conn(0x7fb60806f6a0 0x7fb60806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60d451700 1 -- 172.21.15.88:0/3887732371 >> v1:172.21.15.94:6789/0 conn(0x7fb608150b30 legacy=0x7fb60806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60d451700 1 -- 172.21.15.88:0/3887732371 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60806bcb0 con 0x7fb6080c3e30 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60d451700 1 --2- 172.21.15.88:0/3887732371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb600009e50 tx=0x7fb60000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d31cda24ca1f4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb6077fe700 1 -- 172.21.15.88:0/3887732371 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000e070 con 0x7fb6080c3e30 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb6077fe700 1 -- 172.21.15.88:0/3887732371 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000b910 con 0x7fb6080c3e30 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb6077fe700 1 -- 172.21.15.88:0/3887732371 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000bcc0 con 0x7fb6080c3e30 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- 172.21.15.88:0/3887732371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 msgr2=0x7fb6080c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 --2- 172.21.15.88:0/3887732371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb600009e50 tx=0x7fb60000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- 172.21.15.88:0/3887732371 shutdown_connections 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 --2- 172.21.15.88:0/3887732371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb6080c4280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 --2- 172.21.15.88:0/3887732371 >> v2:172.21.15.94:3300/0 conn(0x7fb60806f6a0 0x7fb60806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- 172.21.15.88:0/3887732371 >> 172.21.15.88:0/3887732371 conn(0x7fb6080ca720 msgr2=0x7fb6080cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- 172.21.15.88:0/3887732371 shutdown_connections 2024-09-13T18:05:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- 172.21.15.88:0/3887732371 wait complete. 2024-09-13T18:05:26.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 Processor -- start 2024-09-13T18:05:26.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.936+0000 7fb60dc52700 1 -- start start 2024-09-13T18:05:26.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60806f6a0 0x7fb608147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb608152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608146090 con 0x7fb608150b30 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb608147390 con 0x7fb60806f6a0 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb608147b90 con 0x7fb6080c3e30 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52492/0 (socket says 172.21.15.88:52492) 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 -- 172.21.15.88:0/1139668473 learned_addr learned my addr 172.21.15.88:0/1139668473 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60cc50700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60806f6a0 0x7fb608147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb607fff700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb608152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 -- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 msgr2=0x7fb608152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb608152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 -- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60806f6a0 msgr2=0x7fb608147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:26.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60806f6a0 0x7fb608147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 -- 172.21.15.88:0/1139668473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600009b30 con 0x7fb608150b30 2024-09-13T18:05:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60d451700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6080c15e0 tx=0x7fb600004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6000048b0 con 0x7fb608150b30 2024-09-13T18:05:26.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6000099b0 con 0x7fb608150b30 2024-09-13T18:05:26.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6081451a0 con 0x7fb608150b30 2024-09-13T18:05:26.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60001c680 con 0x7fb608150b30 2024-09-13T18:05:26.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb608145760 con 0x7fb608150b30 2024-09-13T18:05:26.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.940+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608152f70 con 0x7fb608150b30 2024-09-13T18:05:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.944+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb60001c7e0 con 0x7fb608150b30 2024-09-13T18:05:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.944+0000 7fb6057fa700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 0x7fb5f4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:26.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.944+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb600085a80 con 0x7fb608150b30 2024-09-13T18:05:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.944+0000 7fb60cc50700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 0x7fb5f4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:26.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.944+0000 7fb60cc50700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 0x7fb5f4068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000f60 tx=0x7fb5f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:26.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:26.948+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb608152f70 con 0x7fb608150b30 2024-09-13T18:05:27.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.120+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb608152f70 con 0x7fb608150b30 2024-09-13T18:05:27.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.124+0000 7fb6057fa700 1 -- 172.21.15.88:0/1139668473 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16470 (secure 0 0 0) 0x7fb608152f70 con 0x7fb608150b30 2024-09-13T18:05:27.129 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:27.129 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:26.465046+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 msgr2=0x7fb5f4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 0x7fb5f4068bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8000f60 tx=0x7fb5f8009040 comp rx=0 tx=0).stop 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 msgr2=0x7fb608153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb6080c15e0 tx=0x7fb600004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 shutdown_connections 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb5f4066730 0x7fb5f4068bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6080c3e30 0x7fb608152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb608150b30 0x7fb608153250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 --2- 172.21.15.88:0/1139668473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb60806f6a0 0x7fb608147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 >> 172.21.15.88:0/1139668473 conn(0x7fb6080ca720 msgr2=0x7fb6080c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 shutdown_connections 2024-09-13T18:05:27.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.128+0000 7fb60dc52700 1 -- 172.21.15.88:0/1139668473 wait complete. 2024-09-13T18:05:27.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:05:27.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 Processor -- start 2024-09-13T18:05:27.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 -- start start 2024-09-13T18:05:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d2414fdc0 0x7f0d240c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0d240c7c80 0x7f0d240c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d24156a90 con 0x7f0d240c21c0 2024-09-13T18:05:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d24155f10 con 0x7f0d240c7c80 2024-09-13T18:05:27.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d23fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d241561f0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d227fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0d240c7c80 0x7f0d240c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d237fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0d240c21c0 0x7f0d2406d690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47346/0 (socket says 172.21.15.88:47346) 2024-09-13T18:05:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.252+0000 7f0d237fe700 1 -- 172.21.15.88:0/2416532620 learned_addr learned my addr 172.21.15.88:0/2416532620 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:27.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d22ffd700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d2414fdc0 0x7f0d240c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d227fc700 1 -- 172.21.15.88:0/2416532620 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d2414fdc0 msgr2=0x7f0d240c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:27.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d227fc700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d2414fdc0 0x7f0d240c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d227fc700 1 -- 172.21.15.88:0/2416532620 >> v1:172.21.15.88:6789/0 conn(0x7f0d240c21c0 legacy=0x7f0d2406d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d21ffb700 1 -- 172.21.15.88:0/2416532620 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021623040 0 0) 0x7f0d24156a90 con 0x7f0d240c21c0 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d227fc700 1 -- 172.21.15.88:0/2416532620 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d241564d0 con 0x7f0d240c7c80 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d227fc700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d240c7c80 0x7f0d240c6900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009850 tx=0x7f0d14009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcfc9e8fe634897 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d21ffb700 1 -- 172.21.15.88:0/2416532620 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400f8a0 con 0x7f0d240c7c80 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d21ffb700 1 -- 172.21.15.88:0/2416532620 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400fa00 con 0x7f0d240c7c80 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d21ffb700 1 -- 172.21.15.88:0/2416532620 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400fdb0 con 0x7f0d240c7c80 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 -- 172.21.15.88:0/2416532620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d240c7c80 msgr2=0x7f0d240c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d240c7c80 0x7f0d240c6900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d14009850 tx=0x7f0d14009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 -- 172.21.15.88:0/2416532620 shutdown_connections 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d240c7c80 0x7f0d240c6900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2416532620 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d2414fdc0 0x7f0d240c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 -- 172.21.15.88:0/2416532620 >> 172.21.15.88:0/2416532620 conn(0x7f0d240cb6a0 msgr2=0x7f0d240cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:27.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 -- 172.21.15.88:0/2416532620 shutdown_connections 2024-09-13T18:05:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.256+0000 7f0d23fff700 1 -- 172.21.15.88:0/2416532620 wait complete. 2024-09-13T18:05:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 Processor -- start 2024-09-13T18:05:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- start start 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d240c21c0 0x7f0d240c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d240c7c80 0x7f0d2406f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240c5370 con 0x7f0d2414fdc0 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24070e10 con 0x7f0d240c21c0 2024-09-13T18:05:27.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240c5de0 con 0x7f0d240c7c80 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52520/0 (socket says 172.21.15.88:52520) 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 -- 172.21.15.88:0/2998479591 learned_addr learned my addr 172.21.15.88:0/2998479591 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d227fc700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d240c7c80 0x7f0d2406f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d22ffd700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d240c21c0 0x7f0d240c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 -- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d240c7c80 msgr2=0x7f0d2406f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d240c7c80 0x7f0d2406f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 -- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d240c21c0 msgr2=0x7f0d240c3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d240c21c0 0x7f0d240c3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 -- 172.21.15.88:0/2998479591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d140094b0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d237fe700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00cc10 tx=0x7f0d1c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c00aaa0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1c00ac20 con 0x7f0d2414fdc0 2024-09-13T18:05:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d240c5560 con 0x7f0d2414fdc0 2024-09-13T18:05:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0070d0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.260+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d240c5b00 con 0x7f0d2414fdc0 2024-09-13T18:05:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2406bfc0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0d1c007230 con 0x7f0d2414fdc0 2024-09-13T18:05:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d1b7fe700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 0x7f0d04068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d1c083cd0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d22ffd700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 0x7f0d04068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:27.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.264+0000 7f0d22ffd700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 0x7f0d04068c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009bf0 tx=0x7f0d0c009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:27.276 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.272+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0d1c0510d0 con 0x7f0d2414fdc0 2024-09-13T18:05:27.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:27.480+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0d24155ad0 con 0x7f0d2414fdc0 2024-09-13T18:05:28.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.480+0000 7f0d1b7fe700 1 -- 172.21.15.88:0/2998479591 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0d1c018020 con 0x7f0d2414fdc0 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 msgr2=0x7f0d04068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 0x7f0d04068c20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009bf0 tx=0x7f0d0c009240 comp rx=0 tx=0).stop 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 msgr2=0x7f0d2406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c00cc10 tx=0x7f0d1c00cf20 comp rx=0 tx=0).stop 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 shutdown_connections 2024-09-13T18:05:28.489 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0d04066760 0x7f0d04068c20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0d240c7c80 0x7f0d2406f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0d2414fdc0 0x7f0d2406fcd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 --2- 172.21.15.88:0/2998479591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0d240c21c0 0x7f0d240c3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 >> 172.21.15.88:0/2998479591 conn(0x7f0d240cb6a0 msgr2=0x7f0d24154220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 shutdown_connections 2024-09-13T18:05:28.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.484+0000 7f0d23fff700 1 -- 172.21.15.88:0/2998479591 wait complete. 2024-09-13T18:05:28.505 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300} 2024-09-13T18:05:28.505 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-13T18:05:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 Processor -- start 2024-09-13T18:05:28.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 -- start start 2024-09-13T18:05:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd540153330 0x7fd5400c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5400ca6b0 0x7fd54006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd54006f3e0 0x7fd5400cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5401590e0 con 0x7fd54006f3e0 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54015a0b0 con 0x7fd540153330 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd547152700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400cafd0 con 0x7fd5400ca6b0 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd54006f3e0 0x7fd5400cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd54006f3e0 0x7fd5400cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52526/0 (socket says 172.21.15.88:52526) 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 -- 172.21.15.88:0/3189266776 learned_addr learned my addr 172.21.15.88:0/3189266776 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd54594f700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5400ca6b0 0x7fd54006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546150700 1 --2- 172.21.15.88:0/3189266776 >> v2:172.21.15.94:3300/0 conn(0x7fd540153330 0x7fd5400c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 -- 172.21.15.88:0/3189266776 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5400ca6b0 msgr2=0x7fd54006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5400ca6b0 0x7fd54006eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 -- 172.21.15.88:0/3189266776 >> v2:172.21.15.94:3300/0 conn(0x7fd540153330 msgr2=0x7fd5400c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 --2- 172.21.15.88:0/3189266776 >> v2:172.21.15.94:3300/0 conn(0x7fd540153330 0x7fd5400c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 -- 172.21.15.88:0/3189266776 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5401592f0 con 0x7fd54006f3e0 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd546951700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400cb410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5400cbfa0 tx=0x7fd53800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbf5ec37cd13737 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd54514e700 1 -- 172.21.15.88:0/3189266776 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800e070 con 0x7fd54006f3e0 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd54514e700 1 -- 172.21.15.88:0/3189266776 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53800b910 con 0x7fd54006f3e0 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.620+0000 7fd54514e700 1 -- 172.21.15.88:0/3189266776 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800bcc0 con 0x7fd54006f3e0 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- 172.21.15.88:0/3189266776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 msgr2=0x7fd5400cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400cb410 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd5400cbfa0 tx=0x7fd53800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- 172.21.15.88:0/3189266776 shutdown_connections 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5400ca6b0 0x7fd54006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 --2- 172.21.15.88:0/3189266776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400cb410 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 --2- 172.21.15.88:0/3189266776 >> v2:172.21.15.94:3300/0 conn(0x7fd540153330 0x7fd5400c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- 172.21.15.88:0/3189266776 >> 172.21.15.88:0/3189266776 conn(0x7fd540071c30 msgr2=0x7fd540066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- 172.21.15.88:0/3189266776 shutdown_connections 2024-09-13T18:05:28.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- 172.21.15.88:0/3189266776 wait complete. 2024-09-13T18:05:28.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 Processor -- start 2024-09-13T18:05:28.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.624+0000 7fd547152700 1 -- start start 2024-09-13T18:05:28.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5400ca6b0 0x7fd540153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd540153330 0x7fd5400c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400ce7e0 con 0x7fd54006f3e0 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400c62c0 con 0x7fd5400ca6b0 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5400ce500 con 0x7fd540153330 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52540/0 (socket says 172.21.15.88:52540) 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 -- 172.21.15.88:0/3245524325 learned_addr learned my addr 172.21.15.88:0/3245524325 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd54594f700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5400ca6b0 0x7fd540153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546951700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd540153330 0x7fd5400c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 -- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd540153330 msgr2=0x7fd5400c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd540153330 0x7fd5400c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 -- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5400ca6b0 msgr2=0x7fd540153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5400ca6b0 0x7fd540153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 -- 172.21.15.88:0/3245524325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd538009b30 con 0x7fd54006f3e0 2024-09-13T18:05:28.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd546150700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e9d0 tx=0x7fd53c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c009720 con 0x7fd54006f3e0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00c7f0 con 0x7fd54006f3e0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd540155500 con 0x7fd54006f3e0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00cb60 con 0x7fd54006f3e0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd540155ac0 con 0x7fd54006f3e0 2024-09-13T18:05:28.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.628+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd540153710 con 0x7fd54006f3e0 2024-09-13T18:05:28.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.632+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd53c00ccc0 con 0x7fd54006f3e0 2024-09-13T18:05:28.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.632+0000 7fd536ffd700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 0x7fd524068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:28.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.632+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd53c084520 con 0x7fd54006f3e0 2024-09-13T18:05:28.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.632+0000 7fd54594f700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 0x7fd524068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:28.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.632+0000 7fd54594f700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 0x7fd524068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd540152300 tx=0x7fd530008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:28.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.640+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd53c051920 con 0x7fd54006f3e0 2024-09-13T18:05:28.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:28.840+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7fd540156b00 con 0x7fd54006f3e0 2024-09-13T18:05:29.492 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.488+0000 7fd536ffd700 1 -- 172.21.15.88:0/3245524325 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd53c054f40 con 0x7fd54006f3e0 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 msgr2=0x7fd524068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 0x7fd524068bf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd540152300 tx=0x7fd530008040 comp rx=0 tx=0).stop 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 msgr2=0x7fd5400c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e9d0 tx=0x7fd53c00ed90 comp rx=0 tx=0).stop 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 shutdown_connections 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd524066730 0x7fd524068bf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd540153330 0x7fd5400c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5400ca6b0 0x7fd540153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 --2- 172.21.15.88:0/3245524325 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd54006f3e0 0x7fd5400c5d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 >> 172.21.15.88:0/3245524325 conn(0x7fd540071c30 msgr2=0x7fd5400cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:29.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 shutdown_connections 2024-09-13T18:05:29.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.492+0000 7fd547152700 1 -- 172.21.15.88:0/3245524325 wait complete. 2024-09-13T18:05:29.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:05:29.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 Processor -- start 2024-09-13T18:05:29.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 -- start start 2024-09-13T18:05:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2aac070970 0x7f2aac0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac06b200 con 0x7f2aac152f60 2024-09-13T18:05:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aac158f00 con 0x7f2aac0ccde0 2024-09-13T18:05:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab2ace700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aac0cd1f0 con 0x7f2aac070970 2024-09-13T18:05:29.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2aac152f60 0x7f2aac06bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47360/0 (socket says 172.21.15.88:47360) 2024-09-13T18:05:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 -- 172.21.15.88:0/3662607700 learned_addr learned my addr 172.21.15.88:0/3662607700 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:29.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/3662607700 >> v2:172.21.15.94:3300/0 conn(0x7f2aac070970 0x7f2aac0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616203883 0 0) 0x7f2aac06b200 con 0x7f2aac152f60 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a980035d0 con 0x7f2aac152f60 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896563803 0 0) 0x7f2aac158f00 con 0x7f2aac0ccde0 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aac06b200 con 0x7f2aac0ccde0 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3187209760 0 0) 0x7f2a980035d0 con 0x7f2aac152f60 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 >> v2:172.21.15.94:3300/0 conn(0x7f2aac070970 msgr2=0x7f2aac0cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 --2- 172.21.15.88:0/3662607700 >> v2:172.21.15.94:3300/0 conn(0x7f2aac070970 0x7f2aac0cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 >> v1:172.21.15.94:6789/0 conn(0x7f2aac0ccde0 legacy=0x7f2aac0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac1591e0 con 0x7f2aac152f60 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f2aa0001670 con 0x7f2aac152f60 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 >> v1:172.21.15.88:6789/0 conn(0x7f2aac152f60 legacy=0x7f2aac06bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2a98003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a98004870 0x7f2a98004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2a98005230 0x7f2a9800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0cd1f0 con 0x7f2a98003bb0 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9800c020 con 0x7f2a98004870 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9800c1e0 con 0x7f2a98005230 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2a98003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a98004870 0x7f2a98004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab22cd700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2a98005230 0x7f2a9800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 -- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2a98005230 msgr2=0x7f2a9800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2a98005230 0x7f2a9800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 -- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a98004870 msgr2=0x7f2a98004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a98004870 0x7f2a98004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.632+0000 7f2ab22cd700 1 -- 172.21.15.88:0/3662607700 reap_dead start 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab1acc700 1 -- 172.21.15.88:0/3662607700 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a980035d0 con 0x7f2a98003bb0 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2a98004870 0x7f2a98004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2a98003fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c210 tx=0x7f2a980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f641552a9d7b2c84 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa000cd50 con 0x7f2a98003bb0 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa0005980 con 0x7f2a98003bb0 2024-09-13T18:05:29.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab0aca700 1 -- 172.21.15.88:0/3662607700 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0005d30 con 0x7f2a98003bb0 2024-09-13T18:05:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 msgr2=0x7f2a98003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2a98003fb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c210 tx=0x7f2a980058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- 172.21.15.88:0/3662607700 shutdown_connections 2024-09-13T18:05:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/3662607700 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2a98003fb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- 172.21.15.88:0/3662607700 >> 172.21.15.88:0/3662607700 conn(0x7f2aac06ddb0 msgr2=0x7f2aac06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:29.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- 172.21.15.88:0/3662607700 shutdown_connections 2024-09-13T18:05:29.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- 172.21.15.88:0/3662607700 wait complete. 2024-09-13T18:05:29.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 Processor -- start 2024-09-13T18:05:29.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.636+0000 7f2ab2ace700 1 -- start start 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2aac145ca0 0x7f2aac1ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2aac1428c0 0x7f2aac0cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac153a80 con 0x7f2a98003bb0 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0cb6e0 con 0x7f2aac145ca0 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aac0ca750 con 0x7f2aac1428c0 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52564/0 (socket says 172.21.15.88:52564) 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 -- 172.21.15.88:0/4173145593 learned_addr learned my addr 172.21.15.88:0/4173145593 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab22cd700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2aac1428c0 0x7f2aac0cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2aac145ca0 0x7f2aac1ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 -- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2aac1428c0 msgr2=0x7f2aac0cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2aac1428c0 0x7f2aac0cc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 -- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2aac145ca0 msgr2=0x7f2aac1ee890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2aac145ca0 0x7f2aac1ee890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 -- 172.21.15.88:0/4173145593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aac1ef0b0 con 0x7f2a98003bb0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab1acc700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c800 tx=0x7f2aac0c3ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0007b70 con 0x7f2a98003bb0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aa0004aa0 con 0x7f2a98003bb0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aac1ef390 con 0x7f2a98003bb0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aa0004e30 con 0x7f2a98003bb0 2024-09-13T18:05:29.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.640+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aac0ca9a0 con 0x7f2a98003bb0 2024-09-13T18:05:29.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aac0678f0 con 0x7f2a98003bb0 2024-09-13T18:05:29.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2aa00070d0 con 0x7f2a98003bb0 2024-09-13T18:05:29.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2a9e7fc700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 0x7f2a90068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:29.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2aa0084dd0 con 0x7f2a98003bb0 2024-09-13T18:05:29.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 0x7f2a90068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:29.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.644+0000 7f2ab12cb700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 0x7f2a90068c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2aac151090 tx=0x7f2aa8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:29.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.652+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2aa0052250 con 0x7f2a98003bb0 2024-09-13T18:05:29.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:29.860+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2aac158f00 con 0x7f2a98003bb0 2024-09-13T18:05:30.495 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.492+0000 7f2a9e7fc700 1 -- 172.21.15.88:0/4173145593 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2aa0055870 con 0x7f2a98003bb0 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 msgr2=0x7f2a90068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 0x7f2a90068c20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2aac151090 tx=0x7f2aa8008040 comp rx=0 tx=0).stop 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 msgr2=0x7f2aac0cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2aa000c800 tx=0x7f2aac0c3ac0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 shutdown_connections 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2a90066760 0x7f2a90068c20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2aac1428c0 0x7f2aac0cc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2aac145ca0 0x7f2aac1ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 --2- 172.21.15.88:0/4173145593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2a98003bb0 0x7f2aac0cb1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 >> 172.21.15.88:0/4173145593 conn(0x7f2aac06ddb0 msgr2=0x7f2aac152270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 shutdown_connections 2024-09-13T18:05:30.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.496+0000 7f2ab2ace700 1 -- 172.21.15.88:0/4173145593 wait complete. 2024-09-13T18:05:30.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-09-13T18:05:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 Processor -- start 2024-09-13T18:05:30.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 -- start start 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5e4153330 0x7fa5e40c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa5e40cab00 0x7fa5e40cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5e415a0b0 con 0x7fa5e40ca6b0 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e41590e0 con 0x7fa5e4153330 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e8875700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5e40cafd0 con 0x7fa5e40cab00 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5e4153330 0x7fa5e40c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5daffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa5e40ca6b0 0x7fa5e406eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54558/0 (socket says 172.21.15.88:54558) 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5daffd700 1 -- 172.21.15.88:0/2715648417 learned_addr learned my addr 172.21.15.88:0/2715648417 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:30.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.636+0000 7fa5e3fff700 1 --2- 172.21.15.88:0/2715648417 >> v2:172.21.15.94:3300/0 conn(0x7fa5e40cab00 0x7fa5e40cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e2ffd700 1 -- 172.21.15.88:0/2715648417 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993558801 0 0) 0x7fa5e415a0b0 con 0x7fa5e40ca6b0 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e2ffd700 1 -- 172.21.15.88:0/2715648417 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5c40035d0 con 0x7fa5e40ca6b0 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e37fe700 1 -- 172.21.15.88:0/2715648417 >> v2:172.21.15.94:3300/0 conn(0x7fa5e40cab00 msgr2=0x7fa5e40cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e37fe700 1 --2- 172.21.15.88:0/2715648417 >> v2:172.21.15.94:3300/0 conn(0x7fa5e40cab00 0x7fa5e40cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e37fe700 1 -- 172.21.15.88:0/2715648417 >> v1:172.21.15.88:6789/0 conn(0x7fa5e40ca6b0 legacy=0x7fa5e406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e37fe700 1 -- 172.21.15.88:0/2715648417 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e41592f0 con 0x7fa5e4153330 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e37fe700 1 --2- 172.21.15.88:0/2715648417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e4153330 0x7fa5e40c3c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40b3e50 tx=0x7fa5d4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143c3f71ade1c1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e2ffd700 1 -- 172.21.15.88:0/2715648417 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4011830 con 0x7fa5e4153330 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e2ffd700 1 -- 172.21.15.88:0/2715648417 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d4011990 con 0x7fa5e4153330 2024-09-13T18:05:30.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e2ffd700 1 -- 172.21.15.88:0/2715648417 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d4011d20 con 0x7fa5e4153330 2024-09-13T18:05:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 -- 172.21.15.88:0/2715648417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e4153330 msgr2=0x7fa5e40c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2715648417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e4153330 0x7fa5e40c3c60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40b3e50 tx=0x7fa5d4009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 -- 172.21.15.88:0/2715648417 shutdown_connections 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2715648417 >> v2:172.21.15.94:3300/0 conn(0x7fa5e40cab00 0x7fa5e40cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2715648417 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e4153330 0x7fa5e40c3c60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 -- 172.21.15.88:0/2715648417 >> 172.21.15.88:0/2715648417 conn(0x7fa5e4071c30 msgr2=0x7fa5e4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 -- 172.21.15.88:0/2715648417 shutdown_connections 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.640+0000 7fa5e8875700 1 -- 172.21.15.88:0/2715648417 wait complete. 2024-09-13T18:05:30.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 Processor -- start 2024-09-13T18:05:30.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- start start 2024-09-13T18:05:30.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e40ca6b0 0x7fa5e41eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa5e414f7d0 0x7fa5e4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e40cd100 con 0x7fa5e40cab00 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41486b0 con 0x7fa5e40ca6b0 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41507b0 con 0x7fa5e414f7d0 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48646/0 (socket says 172.21.15.88:48646) 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 -- 172.21.15.88:0/2461222846 learned_addr learned my addr 172.21.15.88:0/2461222846 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e37fe700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e40ca6b0 0x7fa5e41eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e3fff700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa5e414f7d0 0x7fa5e4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 -- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa5e414f7d0 msgr2=0x7fa5e4155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa5e414f7d0 0x7fa5e4155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 -- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e40ca6b0 msgr2=0x7fa5e41eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e40ca6b0 0x7fa5e41eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 -- 172.21.15.88:0/2461222846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40094b0 con 0x7fa5e40cab00 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5daffd700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c700 tx=0x7fa5cc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc005d90 con 0x7fa5e40cab00 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5cc0070d0 con 0x7fa5e40cab00 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e4150a90 con 0x7fa5e40cab00 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5cc007480 con 0x7fa5e40cab00 2024-09-13T18:05:30.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.644+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e4151050 con 0x7fa5e40cab00 2024-09-13T18:05:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5e4153710 con 0x7fa5e40cab00 2024-09-13T18:05:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa5cc0075e0 con 0x7fa5e40cab00 2024-09-13T18:05:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e0ff9700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 0x7fa5c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:30.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5cc083880 con 0x7fa5e40cab00 2024-09-13T18:05:30.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e37fe700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 0x7fa5c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:30.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.648+0000 7fa5e37fe700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 0x7fa5c8068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40cbf70 tx=0x7fa5d4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:30.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.656+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa5cc050ad0 con 0x7fa5e40cab00 2024-09-13T18:05:30.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:30.876+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fa5e40c9fb0 con 0x7fa5e40cab00 2024-09-13T18:05:31.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.500+0000 7fa5e0ff9700 1 -- 172.21.15.88:0/2461222846 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa5cc0540f0 con 0x7fa5e40cab00 2024-09-13T18:05:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 msgr2=0x7fa5c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 0x7fa5c8068bf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40cbf70 tx=0x7fa5d4008030 comp rx=0 tx=0).stop 2024-09-13T18:05:31.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 msgr2=0x7fa5e4150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc00c700 tx=0x7fa5cc00cac0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 shutdown_connections 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa5c8066730 0x7fa5c8068bf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa5e414f7d0 0x7fa5e4155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5e40cab00 0x7fa5e4150110 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 --2- 172.21.15.88:0/2461222846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5e40ca6b0 0x7fa5e41eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 >> 172.21.15.88:0/2461222846 conn(0x7fa5e4071c30 msgr2=0x7fa5e40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 shutdown_connections 2024-09-13T18:05:31.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.504+0000 7fa5e8875700 1 -- 172.21.15.88:0/2461222846 wait complete. 2024-09-13T18:05:31.521 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:05:31.521 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:31.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 Processor -- start 2024-09-13T18:05:31.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 -- start start 2024-09-13T18:05:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdeb0151130 0x7fdeb006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb0066490 0x7fdeb015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdeb006f7a0 0x7fdeb015b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00c7c30 con 0x7fdeb006f7a0 2024-09-13T18:05:31.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb015a650 con 0x7fdeb0151130 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeb4999700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00c7390 con 0x7fdeb0066490 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeaed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdeb006f7a0 0x7fdeb015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeaed9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdeb006f7a0 0x7fdeb015b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48660/0 (socket says 172.21.15.88:48660) 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeaed9d700 1 -- 172.21.15.88:0/22314936 learned_addr learned my addr 172.21.15.88:0/22314936 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeae59c700 1 --2- 172.21.15.88:0/22314936 >> v2:172.21.15.94:3300/0 conn(0x7fdeb0151130 0x7fdeb006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.632+0000 7fdeadd9b700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb0066490 0x7fdeb015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 -- 172.21.15.88:0/22314936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb0066490 msgr2=0x7fdeb015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb0066490 0x7fdeb015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 -- 172.21.15.88:0/22314936 >> v2:172.21.15.94:3300/0 conn(0x7fdeb0151130 msgr2=0x7fdeb006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 --2- 172.21.15.88:0/22314936 >> v2:172.21.15.94:3300/0 conn(0x7fdeb0151130 0x7fdeb006eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 -- 172.21.15.88:0/22314936 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00c7670 con 0x7fdeb006f7a0 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeaed9d700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb006f7a0 0x7fdeb015b020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00cc320 tx=0x7fdea800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6d160dd3d1e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdead59a700 1 -- 172.21.15.88:0/22314936 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800e070 con 0x7fdeb006f7a0 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdead59a700 1 -- 172.21.15.88:0/22314936 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800b910 con 0x7fdeb006f7a0 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdead59a700 1 -- 172.21.15.88:0/22314936 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea800bcc0 con 0x7fdeb006f7a0 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- 172.21.15.88:0/22314936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb006f7a0 msgr2=0x7fdeb015b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb006f7a0 0x7fdeb015b020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00cc320 tx=0x7fdea800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- 172.21.15.88:0/22314936 shutdown_connections 2024-09-13T18:05:31.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb0066490 0x7fdeb015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 --2- 172.21.15.88:0/22314936 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb006f7a0 0x7fdeb015b020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 --2- 172.21.15.88:0/22314936 >> v2:172.21.15.94:3300/0 conn(0x7fdeb0151130 0x7fdeb006eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- 172.21.15.88:0/22314936 >> 172.21.15.88:0/22314936 conn(0x7fdeb00cb290 msgr2=0x7fdeb00cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:31.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- 172.21.15.88:0/22314936 shutdown_connections 2024-09-13T18:05:31.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- 172.21.15.88:0/22314936 wait complete. 2024-09-13T18:05:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 Processor -- start 2024-09-13T18:05:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.636+0000 7fdeb4999700 1 -- start start 2024-09-13T18:05:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.644 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 0x7fdeb0152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdeb0151130 0x7fdeb0152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb0159f50 con 0x7fdeb0066490 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01ef540 con 0x7fdeb0151130 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb01ee950 con 0x7fdeb006f7a0 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48668/0 (socket says 172.21.15.88:48668) 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 -- 172.21.15.88:0/3544284809 learned_addr learned my addr 172.21.15.88:0/3544284809 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeaed9d700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdeb0151130 0x7fdeb0152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeadd9b700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 0x7fdeb0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 -- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 msgr2=0x7fdeb0152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 0x7fdeb0152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 -- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdeb0151130 msgr2=0x7fdeb0152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdeb0151130 0x7fdeb0152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 -- 172.21.15.88:0/3544284809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea8009b30 con 0x7fdeb0066490 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeadd9b700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 0x7fdeb0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeae59c700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdea000e840 tx=0x7fdea000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00095a0 con 0x7fdeb0066490 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea0013680 con 0x7fdeb0066490 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb015a180 con 0x7fdeb0066490 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea00139f0 con 0x7fdeb0066490 2024-09-13T18:05:31.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb01eeef0 con 0x7fdeb0066490 2024-09-13T18:05:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.640+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb014f9f0 con 0x7fdeb0066490 2024-09-13T18:05:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.644+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdea0013b70 con 0x7fdeb0066490 2024-09-13T18:05:31.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.644+0000 7fde9effd700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 0x7fde90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.644+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdea0084080 con 0x7fdeb0066490 2024-09-13T18:05:31.648 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.644+0000 7fdeadd9b700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 0x7fde90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.649 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.644+0000 7fdeadd9b700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 0x7fde90068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdeb014afc0 tx=0x7fdea4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:31.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.652+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdea00513f0 con 0x7fdeb0066490 2024-09-13T18:05:31.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.856+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdeb006eea0 con 0x7fdeb0066490 2024-09-13T18:05:31.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.856+0000 7fde9effd700 1 -- 172.21.15.88:0/3544284809 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6251 (secure 0 0 0) 0x7fdea0054a10 con 0x7fdeb0066490 2024-09-13T18:05:31.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:31.861 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:31.503404+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4294,"mds_1":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 msgr2=0x7fde90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 0x7fde90068bf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdeb014afc0 tx=0x7fdea4008040 comp rx=0 tx=0).stop 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 msgr2=0x7fdeb0159130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdea000e840 tx=0x7fdea000eb50 comp rx=0 tx=0).stop 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 shutdown_connections 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fde90066730 0x7fde90068bf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdeb006f7a0 0x7fdeb0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdeb0151130 0x7fdeb0152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 --2- 172.21.15.88:0/3544284809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdeb0066490 0x7fdeb0159130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 >> 172.21.15.88:0/3544284809 conn(0x7fdeb00cb290 msgr2=0x7fdeb014e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 shutdown_connections 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.864+0000 7fdeb4999700 1 -- 172.21.15.88:0/3544284809 wait complete. 2024-09-13T18:05:31.868 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2024-09-13T18:05:31.880 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.984+0000 7f9a27fff700 1 Processor -- start 2024-09-13T18:05:31.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.984+0000 7f9a27fff700 1 -- start start 2024-09-13T18:05:31.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814fe40 0x7f9a28070e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a280c24e0 0x7f9a281592d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280c39e0 con 0x7f9a28150220 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280c8010 con 0x7f9a280c24e0 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a280ca9a0 con 0x7f9a2814fe40 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a1ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a1ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48674/0 (socket says 172.21.15.88:48674) 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a1ffff700 1 -- 172.21.15.88:0/349499495 learned_addr learned my addr 172.21.15.88:0/349499495 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 --2- 172.21.15.88:0/349499495 >> v2:172.21.15.94:3300/0 conn(0x7f9a280c24e0 0x7f9a281592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a26ffd700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814fe40 0x7f9a28070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 -- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814fe40 msgr2=0x7f9a28070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814fe40 0x7f9a28070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 -- 172.21.15.88:0/349499495 >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 msgr2=0x7f9a28071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 --2- 172.21.15.88:0/349499495 >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 -- 172.21.15.88:0/349499495 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a280cac80 con 0x7f9a280c24e0 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a1ffff700 1 --2- 172.21.15.88:0/349499495 >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a277fe700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a281592d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a280c34a0 tx=0x7f9a2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b3d08d1fb4610 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:31.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a267fc700 1 -- 172.21.15.88:0/349499495 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2000e070 con 0x7f9a280c24e0 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a267fc700 1 -- 172.21.15.88:0/349499495 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2000bb20 con 0x7f9a280c24e0 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a267fc700 1 -- 172.21.15.88:0/349499495 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20012430 con 0x7f9a280c24e0 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 msgr2=0x7f9a281592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a281592d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a280c34a0 tx=0x7f9a2000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- 172.21.15.88:0/349499495 shutdown_connections 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a281592d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- 172.21.15.88:0/349499495 >> v2:172.21.15.88:3300/0 conn(0x7f9a28150220 0x7f9a28071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 --2- 172.21.15.88:0/349499495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814fe40 0x7f9a28070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- 172.21.15.88:0/349499495 >> 172.21.15.88:0/349499495 conn(0x7f9a2806aa30 msgr2=0x7f9a280cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- 172.21.15.88:0/349499495 shutdown_connections 2024-09-13T18:05:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.988+0000 7f9a27fff700 1 -- 172.21.15.88:0/349499495 wait complete. 2024-09-13T18:05:31.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 Processor -- start 2024-09-13T18:05:31.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 -- start start 2024-09-13T18:05:32.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a28144540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814c310 0x7f9a281eed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281ebce0 con 0x7f9a2814fe40 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281ec210 con 0x7f9a280c24e0 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a27fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a281ebf30 con 0x7f9a2814c310 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a1ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a1ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48678/0 (socket says 172.21.15.88:48678) 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a1ffff700 1 -- 172.21.15.88:0/4231451570 learned_addr learned my addr 172.21.15.88:0/4231451570 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a26ffd700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a28144540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.992+0000 7f9a277fe700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814c310 0x7f9a281eed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 -- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814c310 msgr2=0x7f9a281eed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814c310 0x7f9a281eed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 -- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 msgr2=0x7f9a28144540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a28144540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 -- 172.21.15.88:0/4231451570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10009570 con 0x7f9a2814fe40 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1ffff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a10010b90 tx=0x7f9a10010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000ed20 con 0x7f9a2814fe40 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000ee80 con 0x7f9a2814fe40 2024-09-13T18:05:32.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10011690 con 0x7f9a2814fe40 2024-09-13T18:05:32.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a20009a70 con 0x7f9a2814fe40 2024-09-13T18:05:32.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a281521c0 con 0x7f9a2814fe40 2024-09-13T18:05:32.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a280c20b0 con 0x7f9a2814fe40 2024-09-13T18:05:32.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:31.996+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a100117f0 con 0x7f9a2814fe40 2024-09-13T18:05:32.004 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.000+0000 7f9a1f7fe700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 0x7f9a08068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.000+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a100863f0 con 0x7f9a2814fe40 2024-09-13T18:05:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.000+0000 7f9a26ffd700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 0x7f9a08068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.005 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.000+0000 7f9a26ffd700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 0x7f9a08068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009b70 tx=0x7f9a18009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.010 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.008+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9a10053740 con 0x7f9a2814fe40 2024-09-13T18:05:32.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.176+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a28070db0 con 0x7f9a2814fe40 2024-09-13T18:05:32.183 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a1f7fe700 1 -- 172.21.15.88:0/4231451570 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f9a10056d60 con 0x7f9a2814fe40 2024-09-13T18:05:32.183 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:32.184 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 msgr2=0x7f9a08068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 0x7f9a08068bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9a18009b70 tx=0x7f9a18009240 comp rx=0 tx=0).stop 2024-09-13T18:05:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 msgr2=0x7f9a281ee810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a10010b90 tx=0x7f9a10010ea0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.186 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 shutdown_connections 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a08066730 0x7f9a08068bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a2814c310 0x7f9a281eed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2814fe40 0x7f9a281ee810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 --2- 172.21.15.88:0/4231451570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a280c24e0 0x7f9a28144540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 >> 172.21.15.88:0/4231451570 conn(0x7f9a2806aa30 msgr2=0x7f9a2806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 shutdown_connections 2024-09-13T18:05:32.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.180+0000 7f9a27fff700 1 -- 172.21.15.88:0/4231451570 wait complete. 2024-09-13T18:05:32.198 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:05:32.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 Processor -- start 2024-09-13T18:05:32.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 -- start start 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 0x7fa504159af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5040cb480 0x7fa50406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa504153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040ca290 con 0x7fa5040cb480 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040cbbe0 con 0x7fa5040cb0a0 2024-09-13T18:05:32.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa503fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040c9450 con 0x7fa504152dc0 2024-09-13T18:05:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa5027fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5040cb480 0x7fa50406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa5027fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa5040cb480 0x7fa50406eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48686/0 (socket says 172.21.15.88:48686) 2024-09-13T18:05:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.304+0000 7fa5027fc700 1 -- 172.21.15.88:0/2243264624 learned_addr learned my addr 172.21.15.88:0/2243264624 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa502ffd700 1 --2- 172.21.15.88:0/2243264624 >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 0x7fa504159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5037fe700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa504153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 -- 172.21.15.88:0/2243264624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 msgr2=0x7fa504153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa504153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 -- 172.21.15.88:0/2243264624 >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 msgr2=0x7fa504159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 --2- 172.21.15.88:0/2243264624 >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 0x7fa504159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 -- 172.21.15.88:0/2243264624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5040c9710 con 0x7fa5040cb480 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa502ffd700 1 --2- 172.21.15.88:0/2243264624 >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 0x7fa504159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa5027fc700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa50406eea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbef0 tx=0x7fa4f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1a002cc39e95a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa501ffb700 1 -- 172.21.15.88:0/2243264624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011830 con 0x7fa5040cb480 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa501ffb700 1 -- 172.21.15.88:0/2243264624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f4011990 con 0x7fa5040cb480 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa501ffb700 1 -- 172.21.15.88:0/2243264624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f4011d20 con 0x7fa5040cb480 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 -- 172.21.15.88:0/2243264624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 msgr2=0x7fa50406eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa50406eea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5040cbef0 tx=0x7fa4f4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 -- 172.21.15.88:0/2243264624 shutdown_connections 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa504153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 --2- 172.21.15.88:0/2243264624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa50406eea0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 --2- 172.21.15.88:0/2243264624 >> v2:172.21.15.94:3300/0 conn(0x7fa5040cb0a0 0x7fa504159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 -- 172.21.15.88:0/2243264624 >> 172.21.15.88:0/2243264624 conn(0x7fa504071790 msgr2=0x7fa504071ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 -- 172.21.15.88:0/2243264624 shutdown_connections 2024-09-13T18:05:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 -- 172.21.15.88:0/2243264624 wait complete. 2024-09-13T18:05:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.308+0000 7fa503fff700 1 Processor -- start 2024-09-13T18:05:32.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- start start 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa504157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa5040cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa504158ed0 con 0x7fa5040cb480 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040b2670 con 0x7fa5040cb0a0 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5041df0a0 con 0x7fa504152dc0 2024-09-13T18:05:32.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5027fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa504157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa502ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa5040cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa502ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45610/0 (socket says 172.21.15.88:45610) 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa502ffd700 1 -- 172.21.15.88:0/1496802151 learned_addr learned my addr 172.21.15.88:0/1496802151 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 -- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 msgr2=0x7fa504158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 -- 172.21.15.88:0/1496802151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 msgr2=0x7fa504157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa504157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 -- 172.21.15.88:0/1496802151 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f4009570 con 0x7fa504152dc0 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa502ffd700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5027fc700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa504157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa5037fe700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa5040cc8e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00eba0 tx=0x7fa4fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc009a80 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00f040 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5040b3c30 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00cc40 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.312+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5040b2b80 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa504159af0 con 0x7fa504152dc0 2024-09-13T18:05:32.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa4fc014480 con 0x7fa504152dc0 2024-09-13T18:05:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa4eb7fe700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 0x7fa4f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4fc084fd0 con 0x7fa504152dc0 2024-09-13T18:05:32.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa502ffd700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 0x7fa4f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.316+0000 7fa502ffd700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 0x7fa4f0068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8004040 tx=0x7fa4f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.328+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa4fc0523d0 con 0x7fa504152dc0 2024-09-13T18:05:32.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.496+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5040c9fb0 con 0x7fa4f0066730 2024-09-13T18:05:32.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.512+0000 7fa4eb7fe700 1 -- 172.21.15.88:0/1496802151 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262775 (secure 0 0 0) 0x7fa4f8004510 con 0x7fa4f0066730 2024-09-13T18:05:32.521 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 msgr2=0x7fa4f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 0x7fa4f0068bf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4f8004040 tx=0x7fa4f8008040 comp rx=0 tx=0).stop 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 msgr2=0x7fa5040cc8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa5040cc8e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc00eba0 tx=0x7fa4fc00eeb0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 shutdown_connections 2024-09-13T18:05:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa4f0066730 0x7fa4f0068bf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa504152dc0 0x7fa5040cc8e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa5040cb480 0x7fa504157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 --2- 172.21.15.88:0/1496802151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa5040cb0a0 0x7fa504158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 >> 172.21.15.88:0/1496802151 conn(0x7fa504071790 msgr2=0x7fa504071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 shutdown_connections 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.520+0000 7fa503fff700 1 -- 172.21.15.88:0/1496802151 wait complete. 2024-09-13T18:05:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:32.538 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:05:30.952816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238288,"kb_used_data":1612,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736432,"statfs":{"total":773094113280,"available":772850106368,"internally_reserved":0,"allocated":1650688,"data_stored":1688952,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.867242"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755220+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:27.755220+0000","last_peered":"2024-09-13T18:05:27.755220+0000","last_clean":"2024-09-13T18:05:27.755220+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:27.755220+0000","last_undegraded":"2024-09-13T18:05:27.755220+0000","last_fullsized":"2024-09-13T18:05:27.755220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750817+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:27.750817+0000","last_peered":"2024-09-13T18:05:27.750817+0000","last_clean":"2024-09-13T18:05:27.750817+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:27.750817+0000","last_undegraded":"2024-09-13T18:05:27.750817+0000","last_fullsized":"2024-09-13T18:05:27.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747214+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:27.747214+0000","last_peered":"2024-09-13T18:05:27.747214+0000","last_clean":"2024-09-13T18:05:27.747214+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:27.747214+0000","last_undegraded":"2024-09-13T18:05:27.747214+0000","last_fullsized":"2024-09-13T18:05:27.747214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751208+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:27.751208+0000","last_peered":"2024-09-13T18:05:27.751208+0000","last_clean":"2024-09-13T18:05:27.751208+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:27.751208+0000","last_undegraded":"2024-09-13T18:05:27.751208+0000","last_fullsized":"2024-09-13T18:05:27.751208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748288+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:27.748288+0000","last_peered":"2024-09-13T18:05:27.748288+0000","last_clean":"2024-09-13T18:05:27.748288+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:27.748288+0000","last_undegraded":"2024-09-13T18:05:27.748288+0000","last_fullsized":"2024-09-13T18:05:27.748288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.101213+0000","last_change":"2024-09-13T18:05:25.101213+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.101213+0000","last_undegraded":"2024-09-13T18:05:25.101213+0000","last_fullsized":"2024-09-13T18:05:25.101213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750806+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:27.750806+0000","last_peered":"2024-09-13T18:05:27.750806+0000","last_clean":"2024-09-13T18:05:27.750806+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:27.750806+0000","last_undegraded":"2024-09-13T18:05:27.750806+0000","last_fullsized":"2024-09-13T18:05:27.750806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753829+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:27.753829+0000","last_peered":"2024-09-13T18:05:27.753829+0000","last_clean":"2024-09-13T18:05:27.753829+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:27.753829+0000","last_undegraded":"2024-09-13T18:05:27.753829+0000","last_fullsized":"2024-09-13T18:05:27.753829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747775+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:27.747775+0000","last_peered":"2024-09-13T18:05:27.747775+0000","last_clean":"2024-09-13T18:05:27.747775+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:27.747775+0000","last_undegraded":"2024-09-13T18:05:27.747775+0000","last_fullsized":"2024-09-13T18:05:27.747775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102237+0000","last_change":"2024-09-13T18:05:25.102237+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102237+0000","last_undegraded":"2024-09-13T18:05:25.102237+0000","last_fullsized":"2024-09-13T18:05:25.102237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481387+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:27.481387+0000","last_peered":"2024-09-13T18:05:27.481387+0000","last_clean":"2024-09-13T18:05:27.481387+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:27.481387+0000","last_undegraded":"2024-09-13T18:05:27.481387+0000","last_fullsized":"2024-09-13T18:05:27.481387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102653+0000","last_change":"2024-09-13T18:05:25.102653+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102653+0000","last_undegraded":"2024-09-13T18:05:25.102653+0000","last_fullsized":"2024-09-13T18:05:25.102653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.099411+0000","last_change":"2024-09-13T18:05:25.099411+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.099411+0000","last_undegraded":"2024-09-13T18:05:25.099411+0000","last_fullsized":"2024-09-13T18:05:25.099411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102331+0000","last_change":"2024-09-13T18:05:25.102331+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102331+0000","last_undegraded":"2024-09-13T18:05:25.102331+0000","last_fullsized":"2024-09-13T18:05:25.102331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747640+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:27.747640+0000","last_peered":"2024-09-13T18:05:27.747640+0000","last_clean":"2024-09-13T18:05:27.747640+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:27.747640+0000","last_undegraded":"2024-09-13T18:05:27.747640+0000","last_fullsized":"2024-09-13T18:05:27.747640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479550+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:27.479550+0000","last_peered":"2024-09-13T18:05:27.479550+0000","last_clean":"2024-09-13T18:05:27.479550+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:27.479550+0000","last_undegraded":"2024-09-13T18:05:27.479550+0000","last_fullsized":"2024-09-13T18:05:27.479550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.103380+0000","last_change":"2024-09-13T18:05:25.103380+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.103380+0000","last_undegraded":"2024-09-13T18:05:25.103380+0000","last_fullsized":"2024-09-13T18:05:25.103380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.100768+0000","last_change":"2024-09-13T18:05:25.100768+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.100768+0000","last_undegraded":"2024-09-13T18:05:25.100768+0000","last_fullsized":"2024-09-13T18:05:25.100768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480742+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:27.480742+0000","last_peered":"2024-09-13T18:05:27.480742+0000","last_clean":"2024-09-13T18:05:27.480742+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:27.480742+0000","last_undegraded":"2024-09-13T18:05:27.480742+0000","last_fullsized":"2024-09-13T18:05:27.480742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.098913+0000","last_change":"2024-09-13T18:05:25.098913+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.098913+0000","last_undegraded":"2024-09-13T18:05:25.098913+0000","last_fullsized":"2024-09-13T18:05:25.098913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751368+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:27.751368+0000","last_peered":"2024-09-13T18:05:27.751368+0000","last_clean":"2024-09-13T18:05:27.751368+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:27.751368+0000","last_undegraded":"2024-09-13T18:05:27.751368+0000","last_fullsized":"2024-09-13T18:05:27.751368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479444+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:27.479444+0000","last_peered":"2024-09-13T18:05:27.479444+0000","last_clean":"2024-09-13T18:05:27.479444+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:27.479444+0000","last_undegraded":"2024-09-13T18:05:27.479444+0000","last_fullsized":"2024-09-13T18:05:27.479444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.098803+0000","last_change":"2024-09-13T18:05:25.098803+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.098803+0000","last_undegraded":"2024-09-13T18:05:25.098803+0000","last_fullsized":"2024-09-13T18:05:25.098803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.099695+0000","last_change":"2024-09-13T18:05:25.099695+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.099695+0000","last_undegraded":"2024-09-13T18:05:25.099695+0000","last_fullsized":"2024-09-13T18:05:25.099695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480556+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:27.480556+0000","last_peered":"2024-09-13T18:05:27.480556+0000","last_clean":"2024-09-13T18:05:27.480556+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:27.480556+0000","last_undegraded":"2024-09-13T18:05:27.480556+0000","last_fullsized":"2024-09-13T18:05:27.480556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480257+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:27.480257+0000","last_peered":"2024-09-13T18:05:27.480257+0000","last_clean":"2024-09-13T18:05:27.480257+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:27.480257+0000","last_undegraded":"2024-09-13T18:05:27.480257+0000","last_fullsized":"2024-09-13T18:05:27.480257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480441+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:27.480441+0000","last_peered":"2024-09-13T18:05:27.480441+0000","last_clean":"2024-09-13T18:05:27.480441+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:27.480441+0000","last_undegraded":"2024-09-13T18:05:27.480441+0000","last_fullsized":"2024-09-13T18:05:27.480441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755403+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:27.755403+0000","last_peered":"2024-09-13T18:05:27.755403+0000","last_clean":"2024-09-13T18:05:27.755403+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:27.755403+0000","last_undegraded":"2024-09-13T18:05:27.755403+0000","last_fullsized":"2024-09-13T18:05:27.755403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753558+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:27.753558+0000","last_peered":"2024-09-13T18:05:27.753558+0000","last_clean":"2024-09-13T18:05:27.753558+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:27.753558+0000","last_undegraded":"2024-09-13T18:05:27.753558+0000","last_fullsized":"2024-09-13T18:05:27.753558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2329999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.2160000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6870000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:32.543 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:32.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.692+0000 7f1c46b0c700 1 Processor -- start 2024-09-13T18:05:32.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.692+0000 7f1c46b0c700 1 -- start start 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.692+0000 7f1c46b0c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.692+0000 7f1c46b0c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1c400c3f20 0x7f1c400cb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c400c39d0 0x7f1c400cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c400b20d0 con 0x7f1c400c39d0 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c40153780 con 0x7f1c400c3f20 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c9d20 con 0x7f1c401533a0 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c400c39d0 0x7f1c400cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1c400c39d0 0x7f1c400cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48692/0 (socket says 172.21.15.88:48692) 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 -- 172.21.15.88:0/3197700012 learned_addr learned my addr 172.21.15.88:0/3197700012 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c45309700 1 --2- 172.21.15.88:0/3197700012 >> v2:172.21.15.94:3300/0 conn(0x7f1c400c3f20 0x7f1c400cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c45b0a700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 -- 172.21.15.88:0/3197700012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 msgr2=0x7f1c4015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 -- 172.21.15.88:0/3197700012 >> v2:172.21.15.94:3300/0 conn(0x7f1c400c3f20 msgr2=0x7f1c400cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 --2- 172.21.15.88:0/3197700012 >> v2:172.21.15.94:3300/0 conn(0x7f1c400c3f20 0x7f1c400cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 -- 172.21.15.88:0/3197700012 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c400c9760 con 0x7f1c400c39d0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c4630b700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c39d0 0x7f1c400cbc80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c400cfa70 tx=0x7f1c38009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafefbc7088e6986 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c44b08700 1 -- 172.21.15.88:0/3197700012 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011830 con 0x7f1c400c39d0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c44b08700 1 -- 172.21.15.88:0/3197700012 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c38011990 con 0x7f1c400c39d0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c44b08700 1 -- 172.21.15.88:0/3197700012 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c38011d20 con 0x7f1c400c39d0 2024-09-13T18:05:32.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- 172.21.15.88:0/3197700012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c39d0 msgr2=0x7f1c400cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c39d0 0x7f1c400cbc80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1c400cfa70 tx=0x7f1c38009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- 172.21.15.88:0/3197700012 shutdown_connections 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c39d0 0x7f1c400cbc80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/3197700012 >> v2:172.21.15.94:3300/0 conn(0x7f1c400c3f20 0x7f1c400cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/3197700012 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- 172.21.15.88:0/3197700012 >> 172.21.15.88:0/3197700012 conn(0x7f1c40071800 msgr2=0x7f1c40071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- 172.21.15.88:0/3197700012 shutdown_connections 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.696+0000 7f1c46b0c700 1 -- 172.21.15.88:0/3197700012 wait complete. 2024-09-13T18:05:32.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 Processor -- start 2024-09-13T18:05:32.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- start start 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c400c39d0 0x7f1c401f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40158d30 con 0x7f1c400c3f20 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c401582a0 con 0x7f1c400c39d0 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c40158580 con 0x7f1c401533a0 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48698/0 (socket says 172.21.15.88:48698) 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 -- 172.21.15.88:0/297271858 learned_addr learned my addr 172.21.15.88:0/297271858 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45b0a700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c400c39d0 0x7f1c401f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c4630b700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 -- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 msgr2=0x7f1c4015b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 -- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c400c39d0 msgr2=0x7f1c401f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c400c39d0 0x7f1c401f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 -- 172.21.15.88:0/297271858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38009570 con 0x7f1c400c3f20 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c45309700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e940 tx=0x7f1c3000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30013680 con 0x7f1c400c3f20 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300137e0 con 0x7f1c400c3f20 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c30013b70 con 0x7f1c400c3f20 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c401f29e0 con 0x7f1c400c3f20 2024-09-13T18:05:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.700+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c40145c00 con 0x7f1c400c3f20 2024-09-13T18:05:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.704+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4015cf50 con 0x7f1c400c3f20 2024-09-13T18:05:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.704+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1c30013cd0 con 0x7f1c400c3f20 2024-09-13T18:05:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.704+0000 7f1c3e7fc700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 0x7f1c20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.704+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c30084070 con 0x7f1c400c3f20 2024-09-13T18:05:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.704+0000 7f1c45b0a700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 0x7f1c20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.708+0000 7f1c45b0a700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 0x7f1c20068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c28011340 tx=0x7f1c2800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.708+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1c300513e0 con 0x7f1c400c3f20 2024-09-13T18:05:32.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.876+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c400cae50 con 0x7f1c20066730 2024-09-13T18:05:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.892+0000 7f1c3e7fc700 1 -- 172.21.15.88:0/297271858 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+262775 (secure 0 0 0) 0x7f1c2800f040 con 0x7f1c20066730 2024-09-13T18:05:32.898 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 msgr2=0x7f1c20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 0x7f1c20068bf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1c28011340 tx=0x7f1c2800b040 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 msgr2=0x7f1c4015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000e940 tx=0x7f1c3000ec50 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 shutdown_connections 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1c20066730 0x7f1c20068bf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1c401533a0 0x7f1c4015b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c400c3f20 0x7f1c4015b090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 --2- 172.21.15.88:0/297271858 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1c400c39d0 0x7f1c401f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 >> 172.21.15.88:0/297271858 conn(0x7f1c40071800 msgr2=0x7f1c40148860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 shutdown_connections 2024-09-13T18:05:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:32.896+0000 7f1c46b0c700 1 -- 172.21.15.88:0/297271858 wait complete. 2024-09-13T18:05:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:32.913 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:05:30.952816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":178,"acting":178,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":154,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238288,"kb_used_data":1612,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736432,"statfs":{"total":773094113280,"available":772850106368,"internally_reserved":0,"allocated":1650688,"data_stored":1688952,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.867242"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755220+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:27.755220+0000","last_peered":"2024-09-13T18:05:27.755220+0000","last_clean":"2024-09-13T18:05:27.755220+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:27.755220+0000","last_undegraded":"2024-09-13T18:05:27.755220+0000","last_fullsized":"2024-09-13T18:05:27.755220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750817+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:27.750817+0000","last_peered":"2024-09-13T18:05:27.750817+0000","last_clean":"2024-09-13T18:05:27.750817+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:27.750817+0000","last_undegraded":"2024-09-13T18:05:27.750817+0000","last_fullsized":"2024-09-13T18:05:27.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747214+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:27.747214+0000","last_peered":"2024-09-13T18:05:27.747214+0000","last_clean":"2024-09-13T18:05:27.747214+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:27.747214+0000","last_undegraded":"2024-09-13T18:05:27.747214+0000","last_fullsized":"2024-09-13T18:05:27.747214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751208+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:27.751208+0000","last_peered":"2024-09-13T18:05:27.751208+0000","last_clean":"2024-09-13T18:05:27.751208+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:27.751208+0000","last_undegraded":"2024-09-13T18:05:27.751208+0000","last_fullsized":"2024-09-13T18:05:27.751208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748288+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:27.748288+0000","last_peered":"2024-09-13T18:05:27.748288+0000","last_clean":"2024-09-13T18:05:27.748288+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:27.748288+0000","last_undegraded":"2024-09-13T18:05:27.748288+0000","last_fullsized":"2024-09-13T18:05:27.748288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.101213+0000","last_change":"2024-09-13T18:05:25.101213+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.101213+0000","last_undegraded":"2024-09-13T18:05:25.101213+0000","last_fullsized":"2024-09-13T18:05:25.101213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750806+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:27.750806+0000","last_peered":"2024-09-13T18:05:27.750806+0000","last_clean":"2024-09-13T18:05:27.750806+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:27.750806+0000","last_undegraded":"2024-09-13T18:05:27.750806+0000","last_fullsized":"2024-09-13T18:05:27.750806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753829+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:27.753829+0000","last_peered":"2024-09-13T18:05:27.753829+0000","last_clean":"2024-09-13T18:05:27.753829+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:27.753829+0000","last_undegraded":"2024-09-13T18:05:27.753829+0000","last_fullsized":"2024-09-13T18:05:27.753829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747775+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:27.747775+0000","last_peered":"2024-09-13T18:05:27.747775+0000","last_clean":"2024-09-13T18:05:27.747775+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:27.747775+0000","last_undegraded":"2024-09-13T18:05:27.747775+0000","last_fullsized":"2024-09-13T18:05:27.747775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102237+0000","last_change":"2024-09-13T18:05:25.102237+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102237+0000","last_undegraded":"2024-09-13T18:05:25.102237+0000","last_fullsized":"2024-09-13T18:05:25.102237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481387+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:27.481387+0000","last_peered":"2024-09-13T18:05:27.481387+0000","last_clean":"2024-09-13T18:05:27.481387+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:27.481387+0000","last_undegraded":"2024-09-13T18:05:27.481387+0000","last_fullsized":"2024-09-13T18:05:27.481387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102653+0000","last_change":"2024-09-13T18:05:25.102653+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102653+0000","last_undegraded":"2024-09-13T18:05:25.102653+0000","last_fullsized":"2024-09-13T18:05:25.102653+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.099411+0000","last_change":"2024-09-13T18:05:25.099411+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.099411+0000","last_undegraded":"2024-09-13T18:05:25.099411+0000","last_fullsized":"2024-09-13T18:05:25.099411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.102331+0000","last_change":"2024-09-13T18:05:25.102331+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.102331+0000","last_undegraded":"2024-09-13T18:05:25.102331+0000","last_fullsized":"2024-09-13T18:05:25.102331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747640+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:27.747640+0000","last_peered":"2024-09-13T18:05:27.747640+0000","last_clean":"2024-09-13T18:05:27.747640+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:27.747640+0000","last_undegraded":"2024-09-13T18:05:27.747640+0000","last_fullsized":"2024-09-13T18:05:27.747640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479550+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:27.479550+0000","last_peered":"2024-09-13T18:05:27.479550+0000","last_clean":"2024-09-13T18:05:27.479550+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:27.479550+0000","last_undegraded":"2024-09-13T18:05:27.479550+0000","last_fullsized":"2024-09-13T18:05:27.479550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.103380+0000","last_change":"2024-09-13T18:05:25.103380+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.103380+0000","last_undegraded":"2024-09-13T18:05:25.103380+0000","last_fullsized":"2024-09-13T18:05:25.103380+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.100768+0000","last_change":"2024-09-13T18:05:25.100768+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.100768+0000","last_undegraded":"2024-09-13T18:05:25.100768+0000","last_fullsized":"2024-09-13T18:05:25.100768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480742+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:27.480742+0000","last_peered":"2024-09-13T18:05:27.480742+0000","last_clean":"2024-09-13T18:05:27.480742+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:27.480742+0000","last_undegraded":"2024-09-13T18:05:27.480742+0000","last_fullsized":"2024-09-13T18:05:27.480742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:05:26.086173+0000","last_change":"2024-09-13T18:05:26.086173+0000","last_active":"2024-09-13T18:05:26.086173+0000","last_peered":"2024-09-13T18:05:26.086173+0000","last_clean":"2024-09-13T18:05:26.086173+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:26.086173+0000","last_undegraded":"2024-09-13T18:05:26.086173+0000","last_fullsized":"2024-09-13T18:05:26.086173+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.098913+0000","last_change":"2024-09-13T18:05:25.098913+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.098913+0000","last_undegraded":"2024-09-13T18:05:25.098913+0000","last_fullsized":"2024-09-13T18:05:25.098913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751368+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:27.751368+0000","last_peered":"2024-09-13T18:05:27.751368+0000","last_clean":"2024-09-13T18:05:27.751368+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:27.751368+0000","last_undegraded":"2024-09-13T18:05:27.751368+0000","last_fullsized":"2024-09-13T18:05:27.751368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479444+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:27.479444+0000","last_peered":"2024-09-13T18:05:27.479444+0000","last_clean":"2024-09-13T18:05:27.479444+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:27.479444+0000","last_undegraded":"2024-09-13T18:05:27.479444+0000","last_fullsized":"2024-09-13T18:05:27.479444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.098803+0000","last_change":"2024-09-13T18:05:25.098803+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.098803+0000","last_undegraded":"2024-09-13T18:05:25.098803+0000","last_fullsized":"2024-09-13T18:05:25.098803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2024-09-13T18:05:25.099695+0000","last_change":"2024-09-13T18:05:25.099695+0000","last_active":"2024-09-13T18:05:25.078245+0000","last_peered":"2024-09-13T18:05:25.078245+0000","last_clean":"2024-09-13T18:05:25.078245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:05:25.099695+0000","last_undegraded":"2024-09-13T18:05:25.099695+0000","last_fullsized":"2024-09-13T18:05:25.099695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480556+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:27.480556+0000","last_peered":"2024-09-13T18:05:27.480556+0000","last_clean":"2024-09-13T18:05:27.480556+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:27.480556+0000","last_undegraded":"2024-09-13T18:05:27.480556+0000","last_fullsized":"2024-09-13T18:05:27.480556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480257+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:27.480257+0000","last_peered":"2024-09-13T18:05:27.480257+0000","last_clean":"2024-09-13T18:05:27.480257+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:27.480257+0000","last_undegraded":"2024-09-13T18:05:27.480257+0000","last_fullsized":"2024-09-13T18:05:27.480257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480441+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:27.480441+0000","last_peered":"2024-09-13T18:05:27.480441+0000","last_clean":"2024-09-13T18:05:27.480441+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:27.480441+0000","last_undegraded":"2024-09-13T18:05:27.480441+0000","last_fullsized":"2024-09-13T18:05:27.480441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755403+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:27.755403+0000","last_peered":"2024-09-13T18:05:27.755403+0000","last_clean":"2024-09-13T18:05:27.755403+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:27.755403+0000","last_undegraded":"2024-09-13T18:05:27.755403+0000","last_fullsized":"2024-09-13T18:05:27.755403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753558+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:27.753558+0000","last_peered":"2024-09-13T18:05:27.753558+0000","last_clean":"2024-09-13T18:05:27.753558+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:27.753558+0000","last_undegraded":"2024-09-13T18:05:27.753558+0000","last_fullsized":"2024-09-13T18:05:27.753558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":6},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.907}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7549999999999999}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":49802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3160000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2329999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.2160000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6870000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:32.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 Processor -- start 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 -- start start 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f81e00c3e30 0x7f81e00c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e006dce0 con 0x7f81e0150b30 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e006e010 con 0x7f81e00c3e30 2024-09-13T18:05:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.024+0000 7f81e4b25700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e006d140 con 0x7f81e006f6a0 2024-09-13T18:05:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81dffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f81e00c3e30 0x7f81e00c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81df7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f81e0150b30 0x7f81e006e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:50700/0 (socket says 172.21.15.88:50700) 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81df7fe700 1 -- 172.21.15.88:0/1725752594 learned_addr learned my addr 172.21.15.88:0/1725752594 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1725752594 >> v2:172.21.15.94:3300/0 conn(0x7f81e00c3e30 msgr2=0x7f81e00c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 --2- 172.21.15.88:0/1725752594 >> v2:172.21.15.94:3300/0 conn(0x7f81e00c3e30 0x7f81e00c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1725752594 >> v1:172.21.15.94:6789/0 conn(0x7f81e0150b30 legacy=0x7f81e006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1725752594 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e006bcb0 con 0x7f81e006f6a0 2024-09-13T18:05:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81d6ffd700 1 --2- 172.21.15.88:0/1725752594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e006fae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009850 tx=0x7f81c8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05302a0525a5a7c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81deffd700 1 -- 172.21.15.88:0/1725752594 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8011830 con 0x7f81e006f6a0 2024-09-13T18:05:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81deffd700 1 -- 172.21.15.88:0/1725752594 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c8011990 con 0x7f81e006f6a0 2024-09-13T18:05:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81deffd700 1 -- 172.21.15.88:0/1725752594 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8011d40 con 0x7f81e006f6a0 2024-09-13T18:05:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- 172.21.15.88:0/1725752594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 msgr2=0x7f81e006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1725752594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e006fae0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009850 tx=0x7f81c8009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- 172.21.15.88:0/1725752594 shutdown_connections 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1725752594 >> v2:172.21.15.94:3300/0 conn(0x7f81e00c3e30 0x7f81e00c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1725752594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e006fae0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- 172.21.15.88:0/1725752594 >> 172.21.15.88:0/1725752594 conn(0x7f81e00ca720 msgr2=0x7f81e00cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- 172.21.15.88:0/1725752594 shutdown_connections 2024-09-13T18:05:33.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- 172.21.15.88:0/1725752594 wait complete. 2024-09-13T18:05:33.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 Processor -- start 2024-09-13T18:05:33.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.028+0000 7f81e4b25700 1 -- start start 2024-09-13T18:05:33.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e0144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 0x7f81e014f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e01f2a30 con 0x7f81e00c3e30 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e0155840 con 0x7f81e0150b30 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e01f1eb0 con 0x7f81e006f6a0 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48702/0 (socket says 172.21.15.88:48702) 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1362777033 learned_addr learned my addr 172.21.15.88:0/1362777033 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81dffff700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 0x7f81e014f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81df7fe700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e0144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 msgr2=0x7f81e0144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e0144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 msgr2=0x7f81e014f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 0x7f81e014f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 -- 172.21.15.88:0/1362777033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80094b0 con 0x7f81e00c3e30 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81dffff700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 0x7f81e014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81d6ffd700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81c80090b0 tx=0x7f81c8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8004480 con 0x7f81e00c3e30 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c801f070 con 0x7f81e00c3e30 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e01f2190 con 0x7f81e00c3e30 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c8003900 con 0x7f81e00c3e30 2024-09-13T18:05:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e01f2750 con 0x7f81e00c3e30 2024-09-13T18:05:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.032+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e01559f0 con 0x7f81e00c3e30 2024-09-13T18:05:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.036+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f81c8021030 con 0x7f81e00c3e30 2024-09-13T18:05:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.036+0000 7f81dcff9700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 0x7f81c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.036+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c8084cd0 con 0x7f81e00c3e30 2024-09-13T18:05:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.036+0000 7f81df7fe700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 0x7f81c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.036+0000 7f81df7fe700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 0x7f81c0068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81d0005930 tx=0x7f81d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.044+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f81e01559f0 con 0x7f81e00c3e30 2024-09-13T18:05:33.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.208+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81e0067790 con 0x7f81c0066730 2024-09-13T18:05:33.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.224+0000 7f81dcff9700 1 -- 172.21.15.88:0/1362777033 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264598 (secure 0 0 0) 0x7f81e0067790 con 0x7f81c0066730 2024-09-13T18:05:33.233 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 msgr2=0x7f81c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 0x7f81c0068bf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81d0005930 tx=0x7f81d0009040 comp rx=0 tx=0).stop 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 msgr2=0x7f81e014eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f81c80090b0 tx=0x7f81c8004770 comp rx=0 tx=0).stop 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 shutdown_connections 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f81c0066730 0x7f81c0068bf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f81e0150b30 0x7f81e014f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f81e00c3e30 0x7f81e014eb20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 --2- 172.21.15.88:0/1362777033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f81e006f6a0 0x7f81e0144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 >> 172.21.15.88:0/1362777033 conn(0x7f81e00ca720 msgr2=0x7f81e0071720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 shutdown_connections 2024-09-13T18:05:33.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.232+0000 7f81e4b25700 1 -- 172.21.15.88:0/1362777033 wait complete. 2024-09-13T18:05:33.237 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:33.249 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:05:32.953654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238360,"kb_used_data":1684,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736360,"statfs":{"total":773094113280,"available":772850032640,"internally_reserved":0,"allocated":1724416,"data_stored":1727652,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.861748"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755220+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:27.755220+0000","last_peered":"2024-09-13T18:05:27.755220+0000","last_clean":"2024-09-13T18:05:27.755220+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:27.755220+0000","last_undegraded":"2024-09-13T18:05:27.755220+0000","last_fullsized":"2024-09-13T18:05:27.755220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750817+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:27.750817+0000","last_peered":"2024-09-13T18:05:27.750817+0000","last_clean":"2024-09-13T18:05:27.750817+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:27.750817+0000","last_undegraded":"2024-09-13T18:05:27.750817+0000","last_fullsized":"2024-09-13T18:05:27.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747214+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:27.747214+0000","last_peered":"2024-09-13T18:05:27.747214+0000","last_clean":"2024-09-13T18:05:27.747214+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:27.747214+0000","last_undegraded":"2024-09-13T18:05:27.747214+0000","last_fullsized":"2024-09-13T18:05:27.747214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751208+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:27.751208+0000","last_peered":"2024-09-13T18:05:27.751208+0000","last_clean":"2024-09-13T18:05:27.751208+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:27.751208+0000","last_undegraded":"2024-09-13T18:05:27.751208+0000","last_fullsized":"2024-09-13T18:05:27.751208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748288+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:27.748288+0000","last_peered":"2024-09-13T18:05:27.748288+0000","last_clean":"2024-09-13T18:05:27.748288+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:27.748288+0000","last_undegraded":"2024-09-13T18:05:27.748288+0000","last_fullsized":"2024-09-13T18:05:27.748288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479525+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:26.479525+0000","last_peered":"2024-09-13T18:05:26.479525+0000","last_clean":"2024-09-13T18:05:26.479525+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:26.479525+0000","last_undegraded":"2024-09-13T18:05:26.479525+0000","last_fullsized":"2024-09-13T18:05:26.479525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750806+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:27.750806+0000","last_peered":"2024-09-13T18:05:27.750806+0000","last_clean":"2024-09-13T18:05:27.750806+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:27.750806+0000","last_undegraded":"2024-09-13T18:05:27.750806+0000","last_fullsized":"2024-09-13T18:05:27.750806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753829+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:27.753829+0000","last_peered":"2024-09-13T18:05:27.753829+0000","last_clean":"2024-09-13T18:05:27.753829+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:27.753829+0000","last_undegraded":"2024-09-13T18:05:27.753829+0000","last_fullsized":"2024-09-13T18:05:27.753829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747775+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:27.747775+0000","last_peered":"2024-09-13T18:05:27.747775+0000","last_clean":"2024-09-13T18:05:27.747775+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:27.747775+0000","last_undegraded":"2024-09-13T18:05:27.747775+0000","last_fullsized":"2024-09-13T18:05:27.747775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477695+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:26.477695+0000","last_peered":"2024-09-13T18:05:26.477695+0000","last_clean":"2024-09-13T18:05:26.477695+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:26.477695+0000","last_undegraded":"2024-09-13T18:05:26.477695+0000","last_fullsized":"2024-09-13T18:05:26.477695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481387+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:27.481387+0000","last_peered":"2024-09-13T18:05:27.481387+0000","last_clean":"2024-09-13T18:05:27.481387+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:27.481387+0000","last_undegraded":"2024-09-13T18:05:27.481387+0000","last_fullsized":"2024-09-13T18:05:27.481387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.478209+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:26.478209+0000","last_peered":"2024-09-13T18:05:26.478209+0000","last_clean":"2024-09-13T18:05:26.478209+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:26.478209+0000","last_undegraded":"2024-09-13T18:05:26.478209+0000","last_fullsized":"2024-09-13T18:05:26.478209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479364+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:26.479364+0000","last_peered":"2024-09-13T18:05:26.479364+0000","last_clean":"2024-09-13T18:05:26.479364+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:26.479364+0000","last_undegraded":"2024-09-13T18:05:26.479364+0000","last_fullsized":"2024-09-13T18:05:26.479364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477728+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:26.477728+0000","last_peered":"2024-09-13T18:05:26.477728+0000","last_clean":"2024-09-13T18:05:26.477728+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:26.477728+0000","last_undegraded":"2024-09-13T18:05:26.477728+0000","last_fullsized":"2024-09-13T18:05:26.477728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747640+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:27.747640+0000","last_peered":"2024-09-13T18:05:27.747640+0000","last_clean":"2024-09-13T18:05:27.747640+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:27.747640+0000","last_undegraded":"2024-09-13T18:05:27.747640+0000","last_fullsized":"2024-09-13T18:05:27.747640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479550+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:27.479550+0000","last_peered":"2024-09-13T18:05:27.479550+0000","last_clean":"2024-09-13T18:05:27.479550+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:27.479550+0000","last_undegraded":"2024-09-13T18:05:27.479550+0000","last_fullsized":"2024-09-13T18:05:27.479550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477769+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:26.477769+0000","last_peered":"2024-09-13T18:05:26.477769+0000","last_clean":"2024-09-13T18:05:26.477769+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:26.477769+0000","last_undegraded":"2024-09-13T18:05:26.477769+0000","last_fullsized":"2024-09-13T18:05:26.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480742+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:27.480742+0000","last_peered":"2024-09-13T18:05:27.480742+0000","last_clean":"2024-09-13T18:05:27.480742+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:27.480742+0000","last_undegraded":"2024-09-13T18:05:27.480742+0000","last_fullsized":"2024-09-13T18:05:27.480742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479223+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:26.479223+0000","last_peered":"2024-09-13T18:05:26.479223+0000","last_clean":"2024-09-13T18:05:26.479223+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:26.479223+0000","last_undegraded":"2024-09-13T18:05:26.479223+0000","last_fullsized":"2024-09-13T18:05:26.479223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751368+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:27.751368+0000","last_peered":"2024-09-13T18:05:27.751368+0000","last_clean":"2024-09-13T18:05:27.751368+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:27.751368+0000","last_undegraded":"2024-09-13T18:05:27.751368+0000","last_fullsized":"2024-09-13T18:05:27.751368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479444+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:27.479444+0000","last_peered":"2024-09-13T18:05:27.479444+0000","last_clean":"2024-09-13T18:05:27.479444+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:27.479444+0000","last_undegraded":"2024-09-13T18:05:27.479444+0000","last_fullsized":"2024-09-13T18:05:27.479444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.482196+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:26.482196+0000","last_peered":"2024-09-13T18:05:26.482196+0000","last_clean":"2024-09-13T18:05:26.482196+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:26.482196+0000","last_undegraded":"2024-09-13T18:05:26.482196+0000","last_fullsized":"2024-09-13T18:05:26.482196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.480446+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:26.480446+0000","last_peered":"2024-09-13T18:05:26.480446+0000","last_clean":"2024-09-13T18:05:26.480446+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:26.480446+0000","last_undegraded":"2024-09-13T18:05:26.480446+0000","last_fullsized":"2024-09-13T18:05:26.480446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480556+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:27.480556+0000","last_peered":"2024-09-13T18:05:27.480556+0000","last_clean":"2024-09-13T18:05:27.480556+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:27.480556+0000","last_undegraded":"2024-09-13T18:05:27.480556+0000","last_fullsized":"2024-09-13T18:05:27.480556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480257+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:27.480257+0000","last_peered":"2024-09-13T18:05:27.480257+0000","last_clean":"2024-09-13T18:05:27.480257+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:27.480257+0000","last_undegraded":"2024-09-13T18:05:27.480257+0000","last_fullsized":"2024-09-13T18:05:27.480257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480441+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:27.480441+0000","last_peered":"2024-09-13T18:05:27.480441+0000","last_clean":"2024-09-13T18:05:27.480441+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:27.480441+0000","last_undegraded":"2024-09-13T18:05:27.480441+0000","last_fullsized":"2024-09-13T18:05:27.480441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755403+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:27.755403+0000","last_peered":"2024-09-13T18:05:27.755403+0000","last_clean":"2024-09-13T18:05:27.755403+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:27.755403+0000","last_undegraded":"2024-09-13T18:05:27.755403+0000","last_fullsized":"2024-09-13T18:05:27.755403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753558+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:27.753558+0000","last_peered":"2024-09-13T18:05:27.753558+0000","last_clean":"2024-09-13T18:05:27.753558+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:27.753558+0000","last_undegraded":"2024-09-13T18:05:27.753558+0000","last_fullsized":"2024-09-13T18:05:27.753558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2329999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.2160000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6870000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:33.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:05:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 Processor -- start 2024-09-13T18:05:33.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 -- start start 2024-09-13T18:05:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd910150b30 0x7fd91006e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 0x7fd91006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd91006dce0 con 0x7fd9100c3e30 2024-09-13T18:05:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91006e010 con 0x7fd910150b30 2024-09-13T18:05:33.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd915af1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91006d140 con 0x7fd91006f6a0 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd9152f0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9100c3e30 0x7fd91015a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54560/0 (socket says 172.21.15.88:54560) 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.360+0000 7fd9152f0700 1 -- 172.21.15.88:0/3718844560 learned_addr learned my addr 172.21.15.88:0/3718844560 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 --2- 172.21.15.88:0/3718844560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 0x7fd91006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd914aef700 1 --2- 172.21.15.88:0/3718844560 >> v2:172.21.15.94:3300/0 conn(0x7fd910150b30 0x7fd91006e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141525690 0 0) 0x7fd91006dce0 con 0x7fd9100c3e30 2024-09-13T18:05:33.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f80035d0 con 0x7fd9100c3e30 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946748085 0 0) 0x7fd8f80035d0 con 0x7fd9100c3e30 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 -- 172.21.15.88:0/3718844560 >> v2:172.21.15.94:3300/0 conn(0x7fd910150b30 msgr2=0x7fd91006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 --2- 172.21.15.88:0/3718844560 >> v2:172.21.15.94:3300/0 conn(0x7fd910150b30 0x7fd91006e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 -- 172.21.15.88:0/3718844560 >> v1:172.21.15.88:6789/0 conn(0x7fd9100c3e30 legacy=0x7fd91015a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 -- 172.21.15.88:0/3718844560 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91006bcb0 con 0x7fd91006f6a0 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90ffff700 1 --2- 172.21.15.88:0/3718844560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 0x7fd91006fae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd900009d90 tx=0x7fd90000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8079d4677e658b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90000e070 con 0x7fd91006f6a0 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900003a40 con 0x7fd91006f6a0 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd90f7fe700 1 -- 172.21.15.88:0/3718844560 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908001670 con 0x7fd91006f6a0 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 -- 172.21.15.88:0/3718844560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 msgr2=0x7fd91006fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 --2- 172.21.15.88:0/3718844560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 0x7fd91006fae0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd900009d90 tx=0x7fd90000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 -- 172.21.15.88:0/3718844560 shutdown_connections 2024-09-13T18:05:33.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 --2- 172.21.15.88:0/3718844560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd91006f6a0 0x7fd91006fae0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 --2- 172.21.15.88:0/3718844560 >> v2:172.21.15.94:3300/0 conn(0x7fd910150b30 0x7fd91006e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 -- 172.21.15.88:0/3718844560 >> 172.21.15.88:0/3718844560 conn(0x7fd9100ca720 msgr2=0x7fd9100cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 -- 172.21.15.88:0/3718844560 shutdown_connections 2024-09-13T18:05:33.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.364+0000 7fd915af1700 1 -- 172.21.15.88:0/3718844560 wait complete. 2024-09-13T18:05:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 Processor -- start 2024-09-13T18:05:33.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 -- start start 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91006f6a0 0x7fd91014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9100c3e30 0x7fd910149500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd910140ea0 con 0x7fd910150b30 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91014ddd0 con 0x7fd91006f6a0 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd910154280 con 0x7fd9100c3e30 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48712/0 (socket says 172.21.15.88:48712) 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 -- 172.21.15.88:0/717981276 learned_addr learned my addr 172.21.15.88:0/717981276 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:33.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd914aef700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91006f6a0 0x7fd91014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd90ffff700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9100c3e30 0x7fd910149500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 -- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9100c3e30 msgr2=0x7fd910149500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9100c3e30 0x7fd910149500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 -- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91006f6a0 msgr2=0x7fd91014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91006f6a0 0x7fd91014abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 -- 172.21.15.88:0/717981276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900009a70 con 0x7fd910150b30 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd9152f0700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c730 tx=0x7fd90800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908004ca0 con 0x7fd910150b30 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908004e20 con 0x7fd910150b30 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9101ef660 con 0x7fd910150b30 2024-09-13T18:05:33.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.368+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908007310 con 0x7fd910150b30 2024-09-13T18:05:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9101efc20 con 0x7fd910150b30 2024-09-13T18:05:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd908007470 con 0x7fd910150b30 2024-09-13T18:05:33.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9101ef4c0 con 0x7fd910150b30 2024-09-13T18:05:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd90d7fa700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 0x7fd8fc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd908083d60 con 0x7fd910150b30 2024-09-13T18:05:33.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.372+0000 7fd914aef700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 0x7fd8fc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.376+0000 7fd914aef700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 0x7fd8fc068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd904009b50 tx=0x7fd904009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.380+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9101ef4c0 con 0x7fd910150b30 2024-09-13T18:05:33.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:05:33.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:05:33.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.608+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9101ef4c0 con 0x7fd910150b30 2024-09-13T18:05:33.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd90d7fa700 1 -- 172.21.15.88:0/717981276 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1169 (secure 0 0 0) 0x7fd9101ef4c0 con 0x7fd910150b30 2024-09-13T18:05:33.615 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:33.615 INFO:teuthology.orchestra.run.smithi088.stdout:{"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","health":{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1726250720,"num_in_osds":8,"osd_in_since":1726250711,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":244080640,"bytes_avail":772850032640,"bytes_total":773094113280},"fsmap":{"epoch":9,"id":1,"up":2,"in":2,"max":3,"by_rank":[{"filesystem_id":1,"rank":1,"name":"f","status":"up:creating","gid":4285},{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4294}],"up:standby":4},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-13T18:05:09.742708+0000","services":{}},"progress_events":{}} 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 msgr2=0x7fd8fc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 0x7fd8fc068bf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd904009b50 tx=0x7fd904009240 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 msgr2=0x7fd91014c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd90800c730 tx=0x7fd90800ca40 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 shutdown_connections 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8fc066730 0x7fd8fc068bf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9100c3e30 0x7fd910149500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd910150b30 0x7fd91014c2a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 --2- 172.21.15.88:0/717981276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91006f6a0 0x7fd91014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 >> 172.21.15.88:0/717981276 conn(0x7fd9100ca720 msgr2=0x7fd9100cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 shutdown_connections 2024-09-13T18:05:33.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.612+0000 7fd915af1700 1 -- 172.21.15.88:0/717981276 wait complete. 2024-09-13T18:05:33.629 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:05:33.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 Processor -- start 2024-09-13T18:05:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 -- start start 2024-09-13T18:05:33.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9ba81422c0 0x7f9ba815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba80cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba815d530 con 0x7f9ba81426a0 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba806fdf0 con 0x7f9ba81422c0 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bad153700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba806ea90 con 0x7f9ba806f680 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9ba7fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9ba81422c0 0x7f9ba815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.744+0000 7f9bac952700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba80cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba77fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f9ba81426a0 0x7f9ba815a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:50704/0 (socket says 172.21.15.88:50704) 2024-09-13T18:05:33.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba77fe700 1 -- 172.21.15.88:0/4273814662 learned_addr learned my addr 172.21.15.88:0/4273814662 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba7fff700 1 -- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 msgr2=0x7f9ba80cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba7fff700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba80cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba7fff700 1 -- 172.21.15.88:0/4273814662 >> v1:172.21.15.94:6789/0 conn(0x7f9ba81426a0 legacy=0x7f9ba815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba6ffd700 1 -- 172.21.15.88:0/4273814662 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583485649 0 0) 0x7f9ba815d530 con 0x7f9ba81426a0 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba7fff700 1 -- 172.21.15.88:0/4273814662 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8159fc0 con 0x7f9ba81422c0 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bac952700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba80cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba7fff700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815cff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009880 tx=0x7f9b98009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ca1ec4242b5c8c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba6ffd700 1 -- 172.21.15.88:0/4273814662 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98011830 con 0x7f9ba81422c0 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba6ffd700 1 -- 172.21.15.88:0/4273814662 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b98011990 con 0x7f9ba81422c0 2024-09-13T18:05:33.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9ba6ffd700 1 -- 172.21.15.88:0/4273814662 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98011d20 con 0x7f9ba81422c0 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 -- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 msgr2=0x7f9ba815cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815cff0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009880 tx=0x7f9b98009b90 comp rx=0 tx=0).stop 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 -- 172.21.15.88:0/4273814662 shutdown_connections 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba80cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 --2- 172.21.15.88:0/4273814662 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815cff0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 -- 172.21.15.88:0/4273814662 >> 172.21.15.88:0/4273814662 conn(0x7f9ba8066270 msgr2=0x7f9ba8071ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 -- 172.21.15.88:0/4273814662 shutdown_connections 2024-09-13T18:05:33.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.748+0000 7f9bad153700 1 -- 172.21.15.88:0/4273814662 wait complete. 2024-09-13T18:05:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 Processor -- start 2024-09-13T18:05:33.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 -- start start 2024-09-13T18:05:33.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba81f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81f2d00 con 0x7f9ba813bca0 2024-09-13T18:05:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba8137e30 con 0x7f9ba81422c0 2024-09-13T18:05:33.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bad153700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba81f2a20 con 0x7f9ba806f680 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bac952700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bac952700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48720/0 (socket says 172.21.15.88:48720) 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9bac952700 1 -- 172.21.15.88:0/3039872771 learned_addr learned my addr 172.21.15.88:0/3039872771 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9ba77fe700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.752+0000 7f9ba7fff700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba81f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 -- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 msgr2=0x7f9ba81f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba81f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 -- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 msgr2=0x7f9ba815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 -- 172.21.15.88:0/3039872771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba0009a70 con 0x7f9ba813bca0 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bac952700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000efb0 tx=0x7f9ba000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba000cc90 con 0x7f9ba813bca0 2024-09-13T18:05:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba000f040 con 0x7f9ba813bca0 2024-09-13T18:05:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b980094b0 con 0x7f9ba813bca0 2024-09-13T18:05:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0014480 con 0x7f9ba813bca0 2024-09-13T18:05:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba80c31f0 con 0x7f9ba813bca0 2024-09-13T18:05:33.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba80c3410 con 0x7f9ba813bca0 2024-09-13T18:05:33.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.756+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ba00145e0 con 0x7f9ba813bca0 2024-09-13T18:05:33.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.760+0000 7f9ba4ff9700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 0x7f9b94068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:33.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.760+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba0084d80 con 0x7f9ba813bca0 2024-09-13T18:05:33.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.760+0000 7f9ba7fff700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 0x7f9b94068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:33.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.760+0000 7f9ba7fff700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 0x7f9b94068c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b980097d0 tx=0x7f9b98008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:33.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.768+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ba00520e0 con 0x7f9ba813bca0 2024-09-13T18:05:33.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.932+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ba81f2b90 con 0x7f9b94066760 2024-09-13T18:05:33.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.952+0000 7f9ba4ff9700 1 -- 172.21.15.88:0/3039872771 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264598 (secure 0 0 0) 0x7f9ba81f2b90 con 0x7f9b94066760 2024-09-13T18:05:33.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 msgr2=0x7f9b94068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 0x7f9b94068c20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9b980097d0 tx=0x7f9b98008030 comp rx=0 tx=0).stop 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 msgr2=0x7f9ba815b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000efb0 tx=0x7f9ba000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 shutdown_connections 2024-09-13T18:05:33.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9b94066760 0x7f9b94068c20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ba813bca0 0x7f9ba815b080 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba81422c0 0x7f9ba815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 --2- 172.21.15.88:0/3039872771 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ba806f680 0x7f9ba81f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 >> 172.21.15.88:0/3039872771 conn(0x7f9ba8066270 msgr2=0x7f9ba81415f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 shutdown_connections 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:33.956+0000 7f9bad153700 1 -- 172.21.15.88:0/3039872771 wait complete. 2024-09-13T18:05:33.961 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:33.974 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:05:32.953654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238360,"kb_used_data":1684,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736360,"statfs":{"total":773094113280,"available":772850032640,"internally_reserved":0,"allocated":1724416,"data_stored":1727652,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.861748"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755220+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:27.755220+0000","last_peered":"2024-09-13T18:05:27.755220+0000","last_clean":"2024-09-13T18:05:27.755220+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:27.755220+0000","last_undegraded":"2024-09-13T18:05:27.755220+0000","last_fullsized":"2024-09-13T18:05:27.755220+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750817+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:27.750817+0000","last_peered":"2024-09-13T18:05:27.750817+0000","last_clean":"2024-09-13T18:05:27.750817+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:27.750817+0000","last_undegraded":"2024-09-13T18:05:27.750817+0000","last_fullsized":"2024-09-13T18:05:27.750817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747214+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:27.747214+0000","last_peered":"2024-09-13T18:05:27.747214+0000","last_clean":"2024-09-13T18:05:27.747214+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:27.747214+0000","last_undegraded":"2024-09-13T18:05:27.747214+0000","last_fullsized":"2024-09-13T18:05:27.747214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751208+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:27.751208+0000","last_peered":"2024-09-13T18:05:27.751208+0000","last_clean":"2024-09-13T18:05:27.751208+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:27.751208+0000","last_undegraded":"2024-09-13T18:05:27.751208+0000","last_fullsized":"2024-09-13T18:05:27.751208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748288+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:27.748288+0000","last_peered":"2024-09-13T18:05:27.748288+0000","last_clean":"2024-09-13T18:05:27.748288+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:27.748288+0000","last_undegraded":"2024-09-13T18:05:27.748288+0000","last_fullsized":"2024-09-13T18:05:27.748288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479525+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:26.479525+0000","last_peered":"2024-09-13T18:05:26.479525+0000","last_clean":"2024-09-13T18:05:26.479525+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:26.479525+0000","last_undegraded":"2024-09-13T18:05:26.479525+0000","last_fullsized":"2024-09-13T18:05:26.479525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750806+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:27.750806+0000","last_peered":"2024-09-13T18:05:27.750806+0000","last_clean":"2024-09-13T18:05:27.750806+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:27.750806+0000","last_undegraded":"2024-09-13T18:05:27.750806+0000","last_fullsized":"2024-09-13T18:05:27.750806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753829+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:27.753829+0000","last_peered":"2024-09-13T18:05:27.753829+0000","last_clean":"2024-09-13T18:05:27.753829+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:27.753829+0000","last_undegraded":"2024-09-13T18:05:27.753829+0000","last_fullsized":"2024-09-13T18:05:27.753829+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747775+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:27.747775+0000","last_peered":"2024-09-13T18:05:27.747775+0000","last_clean":"2024-09-13T18:05:27.747775+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:27.747775+0000","last_undegraded":"2024-09-13T18:05:27.747775+0000","last_fullsized":"2024-09-13T18:05:27.747775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477695+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:26.477695+0000","last_peered":"2024-09-13T18:05:26.477695+0000","last_clean":"2024-09-13T18:05:26.477695+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:26.477695+0000","last_undegraded":"2024-09-13T18:05:26.477695+0000","last_fullsized":"2024-09-13T18:05:26.477695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481387+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:27.481387+0000","last_peered":"2024-09-13T18:05:27.481387+0000","last_clean":"2024-09-13T18:05:27.481387+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:27.481387+0000","last_undegraded":"2024-09-13T18:05:27.481387+0000","last_fullsized":"2024-09-13T18:05:27.481387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.478209+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:26.478209+0000","last_peered":"2024-09-13T18:05:26.478209+0000","last_clean":"2024-09-13T18:05:26.478209+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:26.478209+0000","last_undegraded":"2024-09-13T18:05:26.478209+0000","last_fullsized":"2024-09-13T18:05:26.478209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479364+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:26.479364+0000","last_peered":"2024-09-13T18:05:26.479364+0000","last_clean":"2024-09-13T18:05:26.479364+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:26.479364+0000","last_undegraded":"2024-09-13T18:05:26.479364+0000","last_fullsized":"2024-09-13T18:05:26.479364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477728+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:26.477728+0000","last_peered":"2024-09-13T18:05:26.477728+0000","last_clean":"2024-09-13T18:05:26.477728+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:26.477728+0000","last_undegraded":"2024-09-13T18:05:26.477728+0000","last_fullsized":"2024-09-13T18:05:26.477728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747640+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:27.747640+0000","last_peered":"2024-09-13T18:05:27.747640+0000","last_clean":"2024-09-13T18:05:27.747640+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:27.747640+0000","last_undegraded":"2024-09-13T18:05:27.747640+0000","last_fullsized":"2024-09-13T18:05:27.747640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479550+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:27.479550+0000","last_peered":"2024-09-13T18:05:27.479550+0000","last_clean":"2024-09-13T18:05:27.479550+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:27.479550+0000","last_undegraded":"2024-09-13T18:05:27.479550+0000","last_fullsized":"2024-09-13T18:05:27.479550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477769+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:26.477769+0000","last_peered":"2024-09-13T18:05:26.477769+0000","last_clean":"2024-09-13T18:05:26.477769+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:26.477769+0000","last_undegraded":"2024-09-13T18:05:26.477769+0000","last_fullsized":"2024-09-13T18:05:26.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480742+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:27.480742+0000","last_peered":"2024-09-13T18:05:27.480742+0000","last_clean":"2024-09-13T18:05:27.480742+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:27.480742+0000","last_undegraded":"2024-09-13T18:05:27.480742+0000","last_fullsized":"2024-09-13T18:05:27.480742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479223+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:26.479223+0000","last_peered":"2024-09-13T18:05:26.479223+0000","last_clean":"2024-09-13T18:05:26.479223+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:26.479223+0000","last_undegraded":"2024-09-13T18:05:26.479223+0000","last_fullsized":"2024-09-13T18:05:26.479223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751368+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:27.751368+0000","last_peered":"2024-09-13T18:05:27.751368+0000","last_clean":"2024-09-13T18:05:27.751368+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:27.751368+0000","last_undegraded":"2024-09-13T18:05:27.751368+0000","last_fullsized":"2024-09-13T18:05:27.751368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479444+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:27.479444+0000","last_peered":"2024-09-13T18:05:27.479444+0000","last_clean":"2024-09-13T18:05:27.479444+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:27.479444+0000","last_undegraded":"2024-09-13T18:05:27.479444+0000","last_fullsized":"2024-09-13T18:05:27.479444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.482196+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:26.482196+0000","last_peered":"2024-09-13T18:05:26.482196+0000","last_clean":"2024-09-13T18:05:26.482196+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:26.482196+0000","last_undegraded":"2024-09-13T18:05:26.482196+0000","last_fullsized":"2024-09-13T18:05:26.482196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.480446+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:26.480446+0000","last_peered":"2024-09-13T18:05:26.480446+0000","last_clean":"2024-09-13T18:05:26.480446+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:26.480446+0000","last_undegraded":"2024-09-13T18:05:26.480446+0000","last_fullsized":"2024-09-13T18:05:26.480446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480556+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:27.480556+0000","last_peered":"2024-09-13T18:05:27.480556+0000","last_clean":"2024-09-13T18:05:27.480556+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:27.480556+0000","last_undegraded":"2024-09-13T18:05:27.480556+0000","last_fullsized":"2024-09-13T18:05:27.480556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480257+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:27.480257+0000","last_peered":"2024-09-13T18:05:27.480257+0000","last_clean":"2024-09-13T18:05:27.480257+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:27.480257+0000","last_undegraded":"2024-09-13T18:05:27.480257+0000","last_fullsized":"2024-09-13T18:05:27.480257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480441+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:27.480441+0000","last_peered":"2024-09-13T18:05:27.480441+0000","last_clean":"2024-09-13T18:05:27.480441+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:27.480441+0000","last_undegraded":"2024-09-13T18:05:27.480441+0000","last_fullsized":"2024-09-13T18:05:27.480441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755403+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:27.755403+0000","last_peered":"2024-09-13T18:05:27.755403+0000","last_clean":"2024-09-13T18:05:27.755403+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:27.755403+0000","last_undegraded":"2024-09-13T18:05:27.755403+0000","last_fullsized":"2024-09-13T18:05:27.755403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753558+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:27.753558+0000","last_peered":"2024-09-13T18:05:27.753558+0000","last_clean":"2024-09-13T18:05:27.753558+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:27.753558+0000","last_undegraded":"2024-09-13T18:05:27.753558+0000","last_fullsized":"2024-09-13T18:05:27.753558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.236}]}]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.2329999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.2160000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.6870000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542148,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]}]},{"osd":4,"up_from":14,"seq":60129542148,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3440000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":188416,"data_stored":62852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":266240,"data_stored":659520,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:36.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:37.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 Processor -- start 2024-09-13T18:05:37.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 -- start start 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd27c14f8b0 0x7fd27c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c159100 con 0x7fd27c0719f0 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c0c2d30 con 0x7fd27c071dd0 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282a77700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c0c3010 con 0x7fd27c14f8b0 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd281a75700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd27c0719f0 0x7fd27c0c1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54576/0 (socket says 172.21.15.88:54576) 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd281a75700 1 -- 172.21.15.88:0/4056706602 learned_addr learned my addr 172.21.15.88:0/4056706602 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:37.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282276700 1 --2- 172.21.15.88:0/4056706602 >> v2:172.21.15.88:3300/0 conn(0x7fd27c14f8b0 0x7fd27c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1314450701 0 0) 0x7fd27c159100 con 0x7fd27c0719f0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2680035d0 con 0x7fd27c0719f0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962102298 0 0) 0x7fd27c0c2d30 con 0x7fd27c071dd0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c159100 con 0x7fd27c071dd0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4185696873 0 0) 0x7fd2680035d0 con 0x7fd27c0719f0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.096+0000 7fd282276700 1 -- 172.21.15.88:0/4056706602 >> v1:172.21.15.94:6789/0 conn(0x7fd27c071dd0 legacy=0x7fd27c159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 -- 172.21.15.88:0/4056706602 >> v1:172.21.15.88:6789/0 conn(0x7fd27c0719f0 legacy=0x7fd27c0c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 -- 172.21.15.88:0/4056706602 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c0c32f0 con 0x7fd27c14f8b0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 --2- 172.21.15.88:0/4056706602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c14fce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd274009d90 tx=0x7fd27400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e26f813e83e665 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27400e070 con 0x7fd27c14f8b0 2024-09-13T18:05:37.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274003a40 con 0x7fd27c14f8b0 2024-09-13T18:05:37.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd280a73700 1 -- 172.21.15.88:0/4056706602 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278001670 con 0x7fd27c14f8b0 2024-09-13T18:05:37.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- 172.21.15.88:0/4056706602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 msgr2=0x7fd27c14fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 --2- 172.21.15.88:0/4056706602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c14fce0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd274009d90 tx=0x7fd27400b330 comp rx=0 tx=0).stop 2024-09-13T18:05:37.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- 172.21.15.88:0/4056706602 shutdown_connections 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 --2- 172.21.15.88:0/4056706602 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c14fce0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- 172.21.15.88:0/4056706602 >> 172.21.15.88:0/4056706602 conn(0x7fd27c0ca720 msgr2=0x7fd27c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- 172.21.15.88:0/4056706602 shutdown_connections 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- 172.21.15.88:0/4056706602 wait complete. 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 Processor -- start 2024-09-13T18:05:37.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- start start 2024-09-13T18:05:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd27c0719f0 0x7fd27c14eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.106 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd27c071dd0 0x7fd27c1ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0c9c10 con 0x7fd27c14f8b0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c156cf0 con 0x7fd27c0719f0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282a77700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c1572b0 con 0x7fd27c071dd0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48732/0 (socket says 172.21.15.88:48732) 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.100+0000 7fd282276700 1 -- 172.21.15.88:0/3791792913 learned_addr learned my addr 172.21.15.88:0/3791792913 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd281a75700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd27c0719f0 0x7fd27c14eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd281274700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd27c071dd0 0x7fd27c1ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 -- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd27c071dd0 msgr2=0x7fd27c1ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd27c071dd0 0x7fd27c1ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 -- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd27c0719f0 msgr2=0x7fd27c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd27c0719f0 0x7fd27c14eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 -- 172.21.15.88:0/3791792913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274009a70 con 0x7fd27c14f8b0 2024-09-13T18:05:37.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282276700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0cb630 tx=0x7fd274004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274004600 con 0x7fd27c14f8b0 2024-09-13T18:05:37.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd274004760 con 0x7fd27c14f8b0 2024-09-13T18:05:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c146f00 con 0x7fd27c14f8b0 2024-09-13T18:05:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd274012430 con 0x7fd27c14f8b0 2024-09-13T18:05:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c0ca0e0 con 0x7fd27c14f8b0 2024-09-13T18:05:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c155b90 con 0x7fd27c14f8b0 2024-09-13T18:05:37.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.104+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2740125b0 con 0x7fd27c14f8b0 2024-09-13T18:05:37.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.108+0000 7fd2727fc700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 0x7fd260068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.108+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd274084fe0 con 0x7fd27c14f8b0 2024-09-13T18:05:37.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.108+0000 7fd281a75700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 0x7fd260068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.108+0000 7fd281a75700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 0x7fd260068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd278001380 tx=0x7fd2780015f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.112+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd2740522c0 con 0x7fd27c14f8b0 2024-09-13T18:05:37.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.284+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd27c0c4a00 con 0x7fd260066760 2024-09-13T18:05:37.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.304+0000 7fd2727fc700 1 -- 172.21.15.88:0/3791792913 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264702 (secure 0 0 0) 0x7fd27c0c4a00 con 0x7fd260066760 2024-09-13T18:05:37.310 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:37.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 msgr2=0x7fd260068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 0x7fd260068c20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd278001380 tx=0x7fd2780015f0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 msgr2=0x7fd27c1f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0cb630 tx=0x7fd274004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 shutdown_connections 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd260066760 0x7fd260068c20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd27c071dd0 0x7fd27c1ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd27c14f8b0 0x7fd27c1f1db0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 --2- 172.21.15.88:0/3791792913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd27c0719f0 0x7fd27c14eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 >> 172.21.15.88:0/3791792913 conn(0x7fd27c0ca720 msgr2=0x7fd27c0cab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 shutdown_connections 2024-09-13T18:05:37.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.308+0000 7fd282a77700 1 -- 172.21.15.88:0/3791792913 wait complete. 2024-09-13T18:05:37.314 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:37.327 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-13T18:05:36.955025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238368,"kb_used_data":1760,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736352,"statfs":{"total":773094113280,"available":772850024448,"internally_reserved":0,"allocated":1802240,"data_stored":1738676,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003597"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032166+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:30.032166+0000","last_peered":"2024-09-13T18:05:30.032166+0000","last_clean":"2024-09-13T18:05:30.032166+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:30.032166+0000","last_undegraded":"2024-09-13T18:05:30.032166+0000","last_fullsized":"2024-09-13T18:05:30.032166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.026316+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:30.026316+0000","last_peered":"2024-09-13T18:05:30.026316+0000","last_clean":"2024-09-13T18:05:30.026316+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:30.026316+0000","last_undegraded":"2024-09-13T18:05:30.026316+0000","last_fullsized":"2024-09-13T18:05:30.026316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747214+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:27.747214+0000","last_peered":"2024-09-13T18:05:27.747214+0000","last_clean":"2024-09-13T18:05:27.747214+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:27.747214+0000","last_undegraded":"2024-09-13T18:05:27.747214+0000","last_fullsized":"2024-09-13T18:05:27.747214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751208+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:27.751208+0000","last_peered":"2024-09-13T18:05:27.751208+0000","last_clean":"2024-09-13T18:05:27.751208+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:27.751208+0000","last_undegraded":"2024-09-13T18:05:27.751208+0000","last_fullsized":"2024-09-13T18:05:27.751208+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748288+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:27.748288+0000","last_peered":"2024-09-13T18:05:27.748288+0000","last_clean":"2024-09-13T18:05:27.748288+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:27.748288+0000","last_undegraded":"2024-09-13T18:05:27.748288+0000","last_fullsized":"2024-09-13T18:05:27.748288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.486530+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:31.486530+0000","last_peered":"2024-09-13T18:05:31.486530+0000","last_clean":"2024-09-13T18:05:31.486530+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:31.486530+0000","last_undegraded":"2024-09-13T18:05:31.486530+0000","last_fullsized":"2024-09-13T18:05:31.486530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.485115+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:31.485115+0000","last_peered":"2024-09-13T18:05:31.485115+0000","last_clean":"2024-09-13T18:05:31.485115+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:31.485115+0000","last_undegraded":"2024-09-13T18:05:31.485115+0000","last_fullsized":"2024-09-13T18:05:31.485115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488740+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:31.488740+0000","last_peered":"2024-09-13T18:05:31.488740+0000","last_clean":"2024-09-13T18:05:31.488740+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:31.488740+0000","last_undegraded":"2024-09-13T18:05:31.488740+0000","last_fullsized":"2024-09-13T18:05:31.488740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747775+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:27.747775+0000","last_peered":"2024-09-13T18:05:27.747775+0000","last_clean":"2024-09-13T18:05:27.747775+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:27.747775+0000","last_undegraded":"2024-09-13T18:05:27.747775+0000","last_fullsized":"2024-09-13T18:05:27.747775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.493082+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:31.493082+0000","last_peered":"2024-09-13T18:05:31.493082+0000","last_clean":"2024-09-13T18:05:31.493082+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:31.493082+0000","last_undegraded":"2024-09-13T18:05:31.493082+0000","last_fullsized":"2024-09-13T18:05:31.493082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.041113+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:30.041113+0000","last_peered":"2024-09-13T18:05:30.041113+0000","last_clean":"2024-09-13T18:05:30.041113+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:30.041113+0000","last_undegraded":"2024-09-13T18:05:30.041113+0000","last_fullsized":"2024-09-13T18:05:30.041113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.487627+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:31.487627+0000","last_peered":"2024-09-13T18:05:31.487627+0000","last_clean":"2024-09-13T18:05:31.487627+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:31.487627+0000","last_undegraded":"2024-09-13T18:05:31.487627+0000","last_fullsized":"2024-09-13T18:05:31.487627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482911+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:27.482911+0000","last_peered":"2024-09-13T18:05:27.482911+0000","last_clean":"2024-09-13T18:05:27.482911+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:27.482911+0000","last_undegraded":"2024-09-13T18:05:27.482911+0000","last_fullsized":"2024-09-13T18:05:27.482911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477728+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:26.477728+0000","last_peered":"2024-09-13T18:05:26.477728+0000","last_clean":"2024-09-13T18:05:26.477728+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:26.477728+0000","last_undegraded":"2024-09-13T18:05:26.477728+0000","last_fullsized":"2024-09-13T18:05:26.477728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747640+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:27.747640+0000","last_peered":"2024-09-13T18:05:27.747640+0000","last_clean":"2024-09-13T18:05:27.747640+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:27.747640+0000","last_undegraded":"2024-09-13T18:05:27.747640+0000","last_fullsized":"2024-09-13T18:05:27.747640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479550+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:27.479550+0000","last_peered":"2024-09-13T18:05:27.479550+0000","last_clean":"2024-09-13T18:05:27.479550+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:27.479550+0000","last_undegraded":"2024-09-13T18:05:27.479550+0000","last_fullsized":"2024-09-13T18:05:27.479550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477769+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:26.477769+0000","last_peered":"2024-09-13T18:05:26.477769+0000","last_clean":"2024-09-13T18:05:26.477769+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:26.477769+0000","last_undegraded":"2024-09-13T18:05:26.477769+0000","last_fullsized":"2024-09-13T18:05:26.477769+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480742+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:27.480742+0000","last_peered":"2024-09-13T18:05:27.480742+0000","last_clean":"2024-09-13T18:05:27.480742+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:27.480742+0000","last_undegraded":"2024-09-13T18:05:27.480742+0000","last_fullsized":"2024-09-13T18:05:27.480742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.479223+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:26.479223+0000","last_peered":"2024-09-13T18:05:26.479223+0000","last_clean":"2024-09-13T18:05:26.479223+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:26.479223+0000","last_undegraded":"2024-09-13T18:05:26.479223+0000","last_fullsized":"2024-09-13T18:05:26.479223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.484128+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:31.484128+0000","last_peered":"2024-09-13T18:05:31.484128+0000","last_clean":"2024-09-13T18:05:31.484128+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:31.484128+0000","last_undegraded":"2024-09-13T18:05:31.484128+0000","last_fullsized":"2024-09-13T18:05:31.484128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479444+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:27.479444+0000","last_peered":"2024-09-13T18:05:27.479444+0000","last_clean":"2024-09-13T18:05:27.479444+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:27.479444+0000","last_undegraded":"2024-09-13T18:05:27.479444+0000","last_fullsized":"2024-09-13T18:05:27.479444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.482196+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:26.482196+0000","last_peered":"2024-09-13T18:05:26.482196+0000","last_clean":"2024-09-13T18:05:26.482196+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:26.482196+0000","last_undegraded":"2024-09-13T18:05:26.482196+0000","last_fullsized":"2024-09-13T18:05:26.482196+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.480446+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:26.480446+0000","last_peered":"2024-09-13T18:05:26.480446+0000","last_clean":"2024-09-13T18:05:26.480446+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:26.480446+0000","last_undegraded":"2024-09-13T18:05:26.480446+0000","last_fullsized":"2024-09-13T18:05:26.480446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483542+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:31.483542+0000","last_peered":"2024-09-13T18:05:31.483542+0000","last_clean":"2024-09-13T18:05:31.483542+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:31.483542+0000","last_undegraded":"2024-09-13T18:05:31.483542+0000","last_fullsized":"2024-09-13T18:05:31.483542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483826+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:31.483826+0000","last_peered":"2024-09-13T18:05:31.483826+0000","last_clean":"2024-09-13T18:05:31.483826+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:31.483826+0000","last_undegraded":"2024-09-13T18:05:31.483826+0000","last_fullsized":"2024-09-13T18:05:31.483826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483546+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:31.483546+0000","last_peered":"2024-09-13T18:05:31.483546+0000","last_clean":"2024-09-13T18:05:31.483546+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:31.483546+0000","last_undegraded":"2024-09-13T18:05:31.483546+0000","last_fullsized":"2024-09-13T18:05:31.483546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032250+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:30.032250+0000","last_peered":"2024-09-13T18:05:30.032250+0000","last_clean":"2024-09-13T18:05:30.032250+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:30.032250+0000","last_undegraded":"2024-09-13T18:05:30.032250+0000","last_fullsized":"2024-09-13T18:05:30.032250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488604+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:31.488604+0000","last_peered":"2024-09-13T18:05:31.488604+0000","last_clean":"2024-09-13T18:05:31.488604+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:31.488604+0000","last_undegraded":"2024-09-13T18:05:31.488604+0000","last_fullsized":"2024-09-13T18:05:31.488604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":208896,"data_stored":69312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31376,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340464,"statfs":{"total":96636764160,"available":96604635136,"internally_reserved":0,"allocated":270336,"data_stored":660102,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":70716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":69278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":212992,"data_stored":70716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31312,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340528,"statfs":{"total":96636764160,"available":96604700672,"internally_reserved":0,"allocated":204800,"data_stored":69242,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":278528,"data_stored":660158,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.02}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:37.331 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:05:37.331 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:05:37.331 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:05:37.331 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:05:37.331 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:05:37.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.444+0000 7f9abe0fe700 1 Processor -- start 2024-09-13T18:05:37.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.444+0000 7f9abe0fe700 1 -- start start 2024-09-13T18:05:37.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 0x7f9ab806fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab806dce0 con 0x7f9ab80c3e30 2024-09-13T18:05:37.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ab806bcb0 con 0x7f9ab8150b30 2024-09-13T18:05:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab806e010 con 0x7f9ab806f6a0 2024-09-13T18:05:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abd8fd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9ab80c3e30 0x7f9ab81615a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54588/0 (socket says 172.21.15.88:54588) 2024-09-13T18:05:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abd8fd700 1 -- 172.21.15.88:0/2356570098 learned_addr learned my addr 172.21.15.88:0/2356570098 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:37.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abc8fb700 1 --2- 172.21.15.88:0/2356570098 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 0x7f9ab806fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648402484 0 0) 0x7f9ab806dce0 con 0x7f9ab80c3e30 2024-09-13T18:05:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa40035d0 con 0x7f9ab80c3e30 2024-09-13T18:05:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141295329 0 0) 0x7f9ab806bcb0 con 0x7f9ab8150b30 2024-09-13T18:05:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ab806dce0 con 0x7f9ab8150b30 2024-09-13T18:05:37.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abc8fb700 1 -- 172.21.15.88:0/2356570098 >> v1:172.21.15.94:6789/0 conn(0x7f9ab8150b30 legacy=0x7f9ab806e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abc8fb700 1 -- 172.21.15.88:0/2356570098 >> v1:172.21.15.88:6789/0 conn(0x7f9ab80c3e30 legacy=0x7f9ab81615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310847574 0 0) 0x7f9aa40035d0 con 0x7f9ab80c3e30 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abc8fb700 1 -- 172.21.15.88:0/2356570098 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab806bf70 con 0x7f9ab806f6a0 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abc8fb700 1 --2- 172.21.15.88:0/2356570098 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 0x7f9ab806fae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009880 tx=0x7f9aa8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6c82ca744edf99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8011830 con 0x7f9ab806f6a0 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa8011990 con 0x7f9ab806f6a0 2024-09-13T18:05:37.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9aaffff700 1 -- 172.21.15.88:0/2356570098 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8011d20 con 0x7f9ab806f6a0 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- 172.21.15.88:0/2356570098 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 msgr2=0x7f9ab806fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/2356570098 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 0x7f9ab806fae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009880 tx=0x7f9aa8009b90 comp rx=0 tx=0).stop 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- 172.21.15.88:0/2356570098 shutdown_connections 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/2356570098 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab806f6a0 0x7f9ab806fae0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- 172.21.15.88:0/2356570098 >> 172.21.15.88:0/2356570098 conn(0x7f9ab80ca720 msgr2=0x7f9ab80cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- 172.21.15.88:0/2356570098 shutdown_connections 2024-09-13T18:05:37.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.448+0000 7f9abe0fe700 1 -- 172.21.15.88:0/2356570098 wait complete. 2024-09-13T18:05:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 Processor -- start 2024-09-13T18:05:37.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- start start 2024-09-13T18:05:37.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ab80c3e30 0x7f9ab81486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab8150b30 0x7f9ab8148c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8149ab0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8147b80 con 0x7f9ab80c3e30 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab8147370 con 0x7f9ab8150b30 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd8fd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab8150b30 0x7f9ab8148c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48734/0 (socket says 172.21.15.88:48734) 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 -- 172.21.15.88:0/3523675138 learned_addr learned my addr 172.21.15.88:0/3523675138 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:37.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abc8fb700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ab80c3e30 0x7f9ab81486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 -- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab8150b30 msgr2=0x7f9ab8148c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab8150b30 0x7f9ab8148c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 -- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ab80c3e30 msgr2=0x7f9ab81486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ab80c3e30 0x7f9ab81486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 -- 172.21.15.88:0/3523675138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80094b0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abd0fc700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c490 tx=0x7f9ab400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400cea0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40052f0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab813aba0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40036a0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.452+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab80c3ae0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.456+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab8150130 con 0x7f9ab806f6a0 2024-09-13T18:05:37.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.456+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9ab4003800 con 0x7f9ab806f6a0 2024-09-13T18:05:37.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.456+0000 7f9aadffb700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 0x7f9a9c068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.456+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ab4083480 con 0x7f9ab806f6a0 2024-09-13T18:05:37.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.456+0000 7f9abc8fb700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 0x7f9a9c068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.460+0000 7f9abc8fb700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 0x7f9a9c068c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009880 tx=0x7f9aa801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.468+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9ab40508d0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.676+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9ab806b900 con 0x7f9ab806f6a0 2024-09-13T18:05:37.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.684+0000 7f9aadffb700 1 -- 172.21.15.88:0/3523675138 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164898 (secure 0 0 0) 0x7f9ab4053ef0 con 0x7f9ab806f6a0 2024-09-13T18:05:37.689 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:37.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 msgr2=0x7f9a9c068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 0x7f9a9c068c40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8009880 tx=0x7f9aa801c040 comp rx=0 tx=0).stop 2024-09-13T18:05:37.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 msgr2=0x7f9ab8140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400c490 tx=0x7f9ab400c7a0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 shutdown_connections 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a9c066780 0x7f9a9c068c40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ab8150b30 0x7f9ab8148c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ab80c3e30 0x7f9ab81486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 --2- 172.21.15.88:0/3523675138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ab806f6a0 0x7f9ab8140e20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 >> 172.21.15.88:0/3523675138 conn(0x7f9ab80ca720 msgr2=0x7f9ab80c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 shutdown_connections 2024-09-13T18:05:37.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.688+0000 7f9abe0fe700 1 -- 172.21.15.88:0/3523675138 wait complete. 2024-09-13T18:05:37.704 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"flags":0,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":2322387369},{"type":"v1","addr":"172.21.15.94:6833","nonce":2322387369}]},"active_addr":"172.21.15.94:6833/2322387369","active_change":"2024-09-13T18:05:14.938846+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4141,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":1861894453}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":465909778}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":642181663}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.94:0","nonce":2952518873}]}]} 2024-09-13T18:05:37.707 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:05:37.707 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:05:37.707 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:37.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.816+0000 7fc31f003700 1 Processor -- start 2024-09-13T18:05:37.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.816+0000 7fc31f003700 1 -- start start 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d5640 0x7fc310045700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100d5a20 con 0x7fc310050820 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100dbe40 con 0x7fc3100464b0 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc310035950 con 0x7fc3100d5640 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31d800700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc310050820 0x7fc310034b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54592/0 (socket says 172.21.15.88:54592) 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31d800700 1 -- 172.21.15.88:0/978556946 learned_addr learned my addr 172.21.15.88:0/978556946 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889329690 0 0) 0x7fc3100d5a20 con 0x7fc310050820 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e001700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d5640 0x7fc310045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3040057e0 con 0x7fc310050820 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3444448406 0 0) 0x7fc3040057e0 con 0x7fc310050820 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d5640 msgr2=0x7fc310045700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d5640 0x7fc310045700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 >> v1:172.21.15.94:6789/0 conn(0x7fc3100464b0 legacy=0x7fc310035240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100dc120 con 0x7fc310050820 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fc308001670 con 0x7fc310050820 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 >> v1:172.21.15.88:6789/0 conn(0x7fc310050820 legacy=0x7fc310034b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc304005c60 0x7fc304006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc304006a80 0x7fc304006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc304007440 0x7fc30400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc310035950 con 0x7fc304007440 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30400e240 con 0x7fc304006a80 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30400e400 con 0x7fc304005c60 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e001700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d5640 0x7fc310045700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc304007440 0x7fc30400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31d800700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc304006a80 0x7fc304006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e001700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc304005c60 0x7fc304006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 -- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc304005c60 msgr2=0x7fc304006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc304005c60 0x7fc304006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 -- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc304006a80 msgr2=0x7fc304006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc304006a80 0x7fc304006f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 -- 172.21.15.88:0/978556946 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100dc120 con 0x7fc304007440 2024-09-13T18:05:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31d800700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc304006a80 0x7fc304006f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc304007440 0x7fc30400dc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc31804ffd0 tx=0x7fc304007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da60733e7b00ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31804f010 con 0x7fc304007440 2024-09-13T18:05:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3180673d0 con 0x7fc304007440 2024-09-13T18:05:37.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31cfff700 1 -- 172.21.15.88:0/978556946 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318067780 con 0x7fc304007440 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- 172.21.15.88:0/978556946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc304007440 msgr2=0x7fc30400dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 --2- 172.21.15.88:0/978556946 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc304007440 0x7fc30400dc40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc31804ffd0 tx=0x7fc304007ab0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31e802700 1 -- 172.21.15.88:0/978556946 reap_dead start 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- 172.21.15.88:0/978556946 shutdown_connections 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- 172.21.15.88:0/978556946 >> 172.21.15.88:0/978556946 conn(0x7fc31004fd00 msgr2=0x7fc310050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- 172.21.15.88:0/978556946 shutdown_connections 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.820+0000 7fc31f003700 1 -- 172.21.15.88:0/978556946 wait complete. 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 Processor -- start 2024-09-13T18:05:37.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 -- start start 2024-09-13T18:05:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d0020 0x7fc3100c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc310047910 0x7fc3100cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100cd950 con 0x7fc3100d0400 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48750/0 (socket says 172.21.15.88:48750) 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 -- 172.21.15.88:0/2580634902 learned_addr learned my addr 172.21.15.88:0/2580634902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3101710b0 con 0x7fc310047910 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100481e0 con 0x7fc3100d0020 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31e802700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc310047910 0x7fc3100cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31e001700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d0020 0x7fc3100c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 -- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d0020 msgr2=0x7fc3100c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d0020 0x7fc3100c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 -- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc310047910 msgr2=0x7fc3100cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:37.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc310047910 0x7fc3100cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100484c0 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.824+0000 7fc31d800700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc30800eb70 tx=0x7fc30800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308004b60 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc308004cc0 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3100487a0 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc308005250 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc310035d50 con 0x7fc3100d0400 2024-09-13T18:05:37.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31004f630 con 0x7fc3100d0400 2024-09-13T18:05:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc3080053b0 con 0x7fc3100d0400 2024-09-13T18:05:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 0x7fc2fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc308083ac0 con 0x7fc3100d0400 2024-09-13T18:05:37.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.828+0000 7fc31e001700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 0x7fc2fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:37.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.832+0000 7fc31e001700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 0x7fc2fc068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc31004c520 tx=0x7fc314008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:37.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:37.836+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc308050e50 con 0x7fc3100d0400 2024-09-13T18:05:38.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.008+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc310045700 con 0x7fc3100d0400 2024-09-13T18:05:38.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.012+0000 7fc30e7fc700 1 -- 172.21.15.88:0/2580634902 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc308083e60 con 0x7fc3100d0400 2024-09-13T18:05:38.016 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:38.017 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 msgr2=0x7fc2fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 0x7fc2fc068c20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc31004c520 tx=0x7fc314008040 comp rx=0 tx=0).stop 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 msgr2=0x7fc3100c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc30800eb70 tx=0x7fc30800ee80 comp rx=0 tx=0).stop 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 shutdown_connections 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2fc066760 0x7fc2fc068c20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc310047910 0x7fc3100cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc3100d0400 0x7fc3100c5d60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 --2- 172.21.15.88:0/2580634902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc3100d0020 0x7fc3100c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 >> 172.21.15.88:0/2580634902 conn(0x7fc31004fd00 msgr2=0x7fc31004c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 shutdown_connections 2024-09-13T18:05:38.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.016+0000 7fc31f003700 1 -- 172.21.15.88:0/2580634902 wait complete. 2024-09-13T18:05:38.032 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:05:38.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:38.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 Processor -- start 2024-09-13T18:05:38.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 -- start start 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8db81534e0 0x7f8db80c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8db8066490 0x7f8db80c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8db80c0b80 con 0x7f8db80c2030 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db81538c0 con 0x7f8db81534e0 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.136+0000 7f8dbe968700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8db80afb60 con 0x7f8db8066490 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8db81534e0 0x7f8db80c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8db81534e0 0x7f8db80c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48754/0 (socket says 172.21.15.88:48754) 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 -- 172.21.15.88:0/2726155128 learned_addr learned my addr 172.21.15.88:0/2726155128 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe167700 1 --2- 172.21.15.88:0/2726155128 >> v2:172.21.15.94:3300/0 conn(0x7f8db8066490 0x7f8db80c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 -- 172.21.15.88:0/2726155128 >> v2:172.21.15.94:3300/0 conn(0x7f8db8066490 msgr2=0x7f8db80c05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 --2- 172.21.15.88:0/2726155128 >> v2:172.21.15.94:3300/0 conn(0x7f8db8066490 0x7f8db80c05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 -- 172.21.15.88:0/2726155128 >> v1:172.21.15.94:6789/0 conn(0x7f8db80c2030 legacy=0x7f8db806f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 -- 172.21.15.88:0/2726155128 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db80b0230 con 0x7f8db81534e0 2024-09-13T18:05:38.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbd966700 1 --2- 172.21.15.88:0/2726155128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db80c0060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8db8066120 tx=0x7f8db4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbebd153be4bf05b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbc964700 1 -- 172.21.15.88:0/2726155128 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4011830 con 0x7f8db81534e0 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbc964700 1 -- 172.21.15.88:0/2726155128 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db4011990 con 0x7f8db81534e0 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbc964700 1 -- 172.21.15.88:0/2726155128 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db4011d20 con 0x7f8db81534e0 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- 172.21.15.88:0/2726155128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 msgr2=0x7f8db80c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 --2- 172.21.15.88:0/2726155128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db80c0060 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8db8066120 tx=0x7f8db4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- 172.21.15.88:0/2726155128 shutdown_connections 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 --2- 172.21.15.88:0/2726155128 >> v2:172.21.15.94:3300/0 conn(0x7f8db8066490 0x7f8db80c05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 --2- 172.21.15.88:0/2726155128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db80c0060 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- 172.21.15.88:0/2726155128 >> 172.21.15.88:0/2726155128 conn(0x7f8db806a300 msgr2=0x7f8db8070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- 172.21.15.88:0/2726155128 shutdown_connections 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- 172.21.15.88:0/2726155128 wait complete. 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 Processor -- start 2024-09-13T18:05:38.146 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.140+0000 7f8dbe968700 1 -- start start 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 0x7f8db81efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8db80c2030 0x7f8db81e3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db80cbdf0 con 0x7f8db81534e0 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81f26d0 con 0x7f8db8066490 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8db81f23f0 con 0x7f8db80c2030 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48764/0 (socket says 172.21.15.88:48764) 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 -- 172.21.15.88:0/3957462865 learned_addr learned my addr 172.21.15.88:0/3957462865 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbd966700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 0x7f8db81efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbd165700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8db80c2030 0x7f8db81e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 -- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8db80c2030 msgr2=0x7f8db81e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8db80c2030 0x7f8db81e3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 -- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 msgr2=0x7f8db81efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 0x7f8db81efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 -- 172.21.15.88:0/3957462865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db4009570 con 0x7f8db81534e0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbd966700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 0x7f8db81efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe167700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db000efc0 tx=0x7f8db000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0009ca0 con 0x7f8db81534e0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000f040 con 0x7f8db81534e0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8db81eef90 con 0x7f8db81534e0 2024-09-13T18:05:38.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0014480 con 0x7f8db81534e0 2024-09-13T18:05:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.144+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8db81ef550 con 0x7f8db81534e0 2024-09-13T18:05:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8db81ef770 con 0x7f8db81534e0 2024-09-13T18:05:38.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f8db00145e0 con 0x7f8db81534e0 2024-09-13T18:05:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8daa7fc700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 0x7f8d9c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8db0084d90 con 0x7f8db81534e0 2024-09-13T18:05:38.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8dbd966700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 0x7f8d9c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.148+0000 7f8dbd966700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 0x7f8d9c068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000c00 tx=0x7f8db4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.156+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f8db0052100 con 0x7f8db81534e0 2024-09-13T18:05:38.334 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.328+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8db80c1570 con 0x7f8db81534e0 2024-09-13T18:05:38.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.332+0000 7f8daa7fc700 1 -- 172.21.15.88:0/3957462865 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f8db0018090 con 0x7f8db81534e0 2024-09-13T18:05:38.337 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:38.337 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 msgr2=0x7f8d9c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 0x7f8d9c068bf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8db4000c00 tx=0x7f8db4008030 comp rx=0 tx=0).stop 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 msgr2=0x7f8db81e5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8db000efc0 tx=0x7f8db000c3a0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 shutdown_connections 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8d9c066730 0x7f8d9c068bf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8db80c2030 0x7f8db81e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8db81534e0 0x7f8db81e5c40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 --2- 172.21.15.88:0/3957462865 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8db8066490 0x7f8db81efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 >> 172.21.15.88:0/3957462865 conn(0x7f8db806a300 msgr2=0x7f8db80ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 shutdown_connections 2024-09-13T18:05:38.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.336+0000 7f8dbe968700 1 -- 172.21.15.88:0/3957462865 wait complete. 2024-09-13T18:05:38.352 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:05:38.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:05:38.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:05:38.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:05:38.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:05:38.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:05:38.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:05:38.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:05:38.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.496+0000 7fb00e489700 1 Processor -- start 2024-09-13T18:05:38.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.496+0000 7fb00e489700 1 -- start start 2024-09-13T18:05:38.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00e489700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 0x7fb008158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00e489700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb008152dc0 0x7fb008153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00e489700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008153770 con 0x7fb008071470 2024-09-13T18:05:38.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00e489700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00806cdf0 con 0x7fb008152dc0 2024-09-13T18:05:38.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00e489700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb008072530 con 0x7fb00806c300 2024-09-13T18:05:38.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 Processor -- start 2024-09-13T18:05:38.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 -- start start 2024-09-13T18:05:38.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00cc86700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb008071470 0x7fb00806c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54602/0 (socket says 172.21.15.88:54602) 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00cc86700 1 -- 172.21.15.88:0/4082737873 learned_addr learned my addr 172.21.15.88:0/4082737873 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 --2- 172.21.15.88:0/4082737873 >> v2:172.21.15.94:3300/0 conn(0x7fb008152dc0 0x7fb008153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7faffffff700 1 -- 172.21.15.88:0/4082737873 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274483541 0 0) 0x7fb008153770 con 0x7fb008071470 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7faffffff700 1 -- 172.21.15.88:0/4082737873 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff40035d0 con 0x7fb008071470 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 -- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 msgr2=0x7fb008158f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 --2- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 0x7fb008158f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 -- 172.21.15.88:0/4082737873 >> v1:172.21.15.88:6789/0 conn(0x7fb008071470 legacy=0x7fb00806c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 -- 172.21.15.88:0/4082737873 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008071c90 con 0x7fb008152dc0 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fb00dc88700 1 --2- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb008153230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faff8009850 tx=0x7faff8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec512b36589725cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 Processor -- start 2024-09-13T18:05:38.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 Processor -- start 2024-09-13T18:05:38.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 Processor -- start 2024-09-13T18:05:38.506 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 -- start start 2024-09-13T18:05:38.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 -- start start 2024-09-13T18:05:38.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 -- start start 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 0x7f1a3c0c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c20d0 0x7f1a3c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c0c69e0 con 0x7f1a3c150ef0 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c4bc0 con 0x7f1a3c0c47c0 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3bfff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c5af0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 0x7f1a3c0c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3a7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 0x7f1a3c0c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48780/0 (socket says 172.21.15.88:48780) 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3a7fc700 1 -- 172.21.15.88:0/252297400 learned_addr learned my addr 172.21.15.88:0/252297400 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/252297400 >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c20d0 0x7f1a3c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/252297400 >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 msgr2=0x7f1a3c0c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/252297400 >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 0x7f1a3c0c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7faffffff700 1 -- 172.21.15.88:0/4082737873 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8011830 con 0x7fb008152dc0 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7faffffff700 1 -- 172.21.15.88:0/4082737873 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8011990 con 0x7fb008152dc0 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7faffffff700 1 -- 172.21.15.88:0/4082737873 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8011d40 con 0x7fb008152dc0 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa6a80c5090 0x7fa6a8071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa6a80719b0 0x7fa6a81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6a815e370 con 0x7fa6a806c170 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a815df50 con 0x7fa6a80c5090 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fa6ad8ae700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6a815d3a0 con 0x7fa6a80719b0 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4066960 0x7efcc41559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc406b680 0x7efcc414f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcc4155f10 con 0x7efcc40c7120 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcc406c0f0 con 0x7efcc4066960 2024-09-13T18:05:38.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7efcc98b0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc40c1890 con 0x7efcc406b680 2024-09-13T18:05:38.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 msgr2=0x7fb008153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 --2- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb008153230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7faff8009850 tx=0x7faff8009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:38.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 Processor -- start 2024-09-13T18:05:38.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 -- start start 2024-09-13T18:05:38.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa6a80c5090 0x7fa6a8071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa6a80c5090 0x7fa6a8071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48800/0 (socket says 172.21.15.88:48800) 2024-09-13T18:05:38.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 -- 172.21.15.88:0/1145148760 learned_addr learned my addr 172.21.15.88:0/1145148760 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4066960 0x7efcc41559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efcc4066960 0x7efcc41559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48794/0 (socket says 172.21.15.88:48794) 2024-09-13T18:05:38.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 -- 172.21.15.88:0/2088221448 learned_addr learned my addr 172.21.15.88:0/2088221448 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 0x7fc59406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59406c0f0 con 0x7fc594066960 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5940c1890 con 0x7fc59406b680 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7fc5988cc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5940717d0 con 0x7fc5941559d0 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc592d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc594066960 0x7fc59414f180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54626/0 (socket says 172.21.15.88:54626) 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc592d9d700 1 -- 172.21.15.88:0/2407621029 learned_addr learned my addr 172.21.15.88:0/2407621029 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/252297400 >> v1:172.21.15.88:6789/0 conn(0x7f1a3c150ef0 legacy=0x7f1a3c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.500+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/252297400 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0c5dd0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/252297400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c15a5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0c18a0 tx=0x7f1a3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3eff4444d5e6f10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc59359e700 1 --2- 172.21.15.88:0/2407621029 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 0x7fc59406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 -- 172.21.15.88:0/2088221448 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc406b680 msgr2=0x7efcc414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 --2- 172.21.15.88:0/2088221448 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc406b680 0x7efcc414f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 -- 172.21.15.88:0/2088221448 >> v1:172.21.15.94:6789/0 conn(0x7efcc40c7120 legacy=0x7efcc406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 -- 172.21.15.88:0/2088221448 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc414f6c0 con 0x7efcc4066960 2024-09-13T18:05:38.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- 172.21.15.88:0/4082737873 shutdown_connections 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 --2- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb008153230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 --2- 172.21.15.88:0/4082737873 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 0x7fb008158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- 172.21.15.88:0/4082737873 >> 172.21.15.88:0/4082737873 conn(0x7fb0080664b0 msgr2=0x7fb00806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- 172.21.15.88:0/4082737873 shutdown_connections 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e006b680 0x7fc7e01559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e0155f10 con 0x7fc7e006c580 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7e006c0f0 con 0x7fc7e014f180 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7e00c1890 con 0x7fc7e006b680 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e006b680 0x7fc7e01559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc7e006b680 0x7fc7e01559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48804/0 (socket says 172.21.15.88:48804) 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 -- 172.21.15.88:0/2472346465 learned_addr learned my addr 172.21.15.88:0/2472346465 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 -- 172.21.15.88:0/1145148760 >> v2:172.21.15.94:3300/0 conn(0x7fa6a80719b0 msgr2=0x7fa6a81571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 --2- 172.21.15.88:0/1145148760 >> v2:172.21.15.94:3300/0 conn(0x7fa6a80719b0 0x7fa6a81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 -- 172.21.15.88:0/1145148760 >> v1:172.21.15.94:6789/0 conn(0x7fa6a806c170 legacy=0x7fa6a806c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 -- 172.21.15.88:0/1145148760 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a80c1660 con 0x7fa6a80c5090 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc59359e700 1 -- 172.21.15.88:0/2407621029 >> v1:172.21.15.94:6789/0 conn(0x7fc59406b680 legacy=0x7fc5940c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc59359e700 1 -- 172.21.15.88:0/2407621029 >> v1:172.21.15.88:6789/0 conn(0x7fc594066960 legacy=0x7fc59414f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a39ffb700 1 -- 172.21.15.88:0/252297400 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400e070 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a39ffb700 1 -- 172.21.15.88:0/252297400 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400bae0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a39ffb700 1 -- 172.21.15.88:0/252297400 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400be90 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc88ae700 1 --2- 172.21.15.88:0/2088221448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4066960 0x7efcc41559d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e50 tx=0x7efcbc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e256e111e5a9de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc37fe700 1 -- 172.21.15.88:0/2088221448 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc00e070 con 0x7efcc4066960 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc37fe700 1 -- 172.21.15.88:0/2088221448 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcbc003a40 con 0x7efcc4066960 2024-09-13T18:05:38.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc37fe700 1 -- 172.21.15.88:0/2088221448 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcbc003df0 con 0x7efcc4066960 2024-09-13T18:05:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- 172.21.15.88:0/4082737873 wait complete. 2024-09-13T18:05:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a7fff700 1 --2- 172.21.15.88:0/1145148760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a80c5090 0x7fa6a8071470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806e1b0 tx=0x7fa698009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac928e24e3c34e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 -- 172.21.15.88:0/2472346465 >> v1:172.21.15.94:6789/0 conn(0x7fc7e014f180 legacy=0x7fc7e00c7120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 -- 172.21.15.88:0/2472346465 >> v1:172.21.15.88:6789/0 conn(0x7fc7e006c580 legacy=0x7fc7e006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 -- 172.21.15.88:0/2472346465 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e00717d0 con 0x7fc7e006b680 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc59359e700 1 -- 172.21.15.88:0/2407621029 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc594071ab0 con 0x7fc5941559d0 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc59359e700 1 --2- 172.21.15.88:0/2407621029 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 0x7fc59406c580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009dc0 tx=0x7fc58c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f1c04317449806 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc591d9b700 1 -- 172.21.15.88:0/2407621029 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c00e070 con 0x7fc5941559d0 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc591d9b700 1 -- 172.21.15.88:0/2407621029 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c00bad0 con 0x7fc5941559d0 2024-09-13T18:05:38.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc591d9b700 1 -- 172.21.15.88:0/2407621029 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c00be60 con 0x7fc5941559d0 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 -- 172.21.15.88:0/252297400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c20d0 msgr2=0x7f1a3c15a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/252297400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c15a5b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0c18a0 tx=0x7f1a3400b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 -- 172.21.15.88:0/252297400 shutdown_connections 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/252297400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c15a5b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/252297400 >> v2:172.21.15.88:3300/0 conn(0x7f1a3c0c47c0 0x7f1a3c0c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 -- 172.21.15.88:0/252297400 >> 172.21.15.88:0/252297400 conn(0x7f1a3c0664b0 msgr2=0x7f1a3c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 -- 172.21.15.88:0/2088221448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4066960 msgr2=0x7efcc41559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2088221448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4066960 0x7efcc41559d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efcbc009e50 tx=0x7efcbc00b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 -- 172.21.15.88:0/2088221448 shutdown_connections 2024-09-13T18:05:38.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2088221448 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc406b680 0x7efcc414f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2088221448 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc4066960 0x7efcc41559d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 -- 172.21.15.88:0/2088221448 >> 172.21.15.88:0/2088221448 conn(0x7efcc40664b0 msgr2=0x7efcc406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7ddd9b700 1 --2- 172.21.15.88:0/2472346465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006b680 0x7fc7e01559d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009e50 tx=0x7fc7d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9a21722faec3bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 -- 172.21.15.88:0/2088221448 shutdown_connections 2024-09-13T18:05:38.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a77fe700 1 -- 172.21.15.88:0/1145148760 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698004230 con 0x7fa6a80c5090 2024-09-13T18:05:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a77fe700 1 -- 172.21.15.88:0/1145148760 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa698004390 con 0x7fa6a80c5090 2024-09-13T18:05:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6a77fe700 1 -- 172.21.15.88:0/1145148760 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6980036c0 con 0x7fa6a80c5090 2024-09-13T18:05:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 -- 172.21.15.88:0/252297400 shutdown_connections 2024-09-13T18:05:38.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 Processor -- start 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7dd59a700 1 -- 172.21.15.88:0/2472346465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d800e070 con 0x7fc7e006b680 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7dd59a700 1 -- 172.21.15.88:0/2472346465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d8003a40 con 0x7fc7e006b680 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7dd59a700 1 -- 172.21.15.88:0/2472346465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d8003df0 con 0x7fc7e006b680 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc5988cc700 1 -- 172.21.15.88:0/2407621029 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 msgr2=0x7fc59406c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc5988cc700 1 --2- 172.21.15.88:0/2407621029 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 0x7fc59406c580 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc58c009dc0 tx=0x7fc58c00b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc5988cc700 1 -- 172.21.15.88:0/2407621029 shutdown_connections 2024-09-13T18:05:38.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc5988cc700 1 --2- 172.21.15.88:0/2407621029 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc5941559d0 0x7fc59406c580 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc5988cc700 1 -- 172.21.15.88:0/2407621029 >> 172.21.15.88:0/2407621029 conn(0x7fc5940664b0 msgr2=0x7fc59406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fb00e489700 1 -- start start 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 0x7fb008154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 0x7fb0080c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb0081ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008155b20 con 0x7fb008071470 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081ee6e0 con 0x7fb008152dc0 2024-09-13T18:05:38.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080c6f50 con 0x7fb00806c300 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 -- 172.21.15.88:0/2472346465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006b680 msgr2=0x7fc7e01559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fc7df59e700 1 --2- 172.21.15.88:0/2472346465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006b680 0x7fc7e01559d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009e50 tx=0x7fc7d800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc7df59e700 1 -- 172.21.15.88:0/2472346465 shutdown_connections 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc7df59e700 1 --2- 172.21.15.88:0/2472346465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006b680 0x7fc7e01559d0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8009e50 tx=0x7fc7d800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc7df59e700 1 -- 172.21.15.88:0/2472346465 >> 172.21.15.88:0/2472346465 conn(0x7fc7e00664b0 msgr2=0x7fc7e006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/1145148760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a80c5090 msgr2=0x7fa6a8071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/1145148760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a80c5090 0x7fa6a8071470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806e1b0 tx=0x7fa698009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- 172.21.15.88:0/2407621029 shutdown_connections 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7f1a3bfff700 1 -- 172.21.15.88:0/252297400 wait complete. 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 Processor -- start 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.504+0000 7efcc98b0700 1 -- 172.21.15.88:0/2088221448 wait complete. 2024-09-13T18:05:38.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 Processor -- start 2024-09-13T18:05:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- 172.21.15.88:0/2407621029 wait complete. 2024-09-13T18:05:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 0x7fb0080c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 0x7fb0080c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48814/0 (socket says 172.21.15.88:48814) 2024-09-13T18:05:38.527 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 -- 172.21.15.88:0/3552734906 learned_addr learned my addr 172.21.15.88:0/3552734906 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00dc88700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb0081ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 -- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 msgr2=0x7fb008154220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb00806c300 0x7fb008154220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 -- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 msgr2=0x7fb0081ef1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb008152dc0 0x7fb0081ef1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff80094b0 con 0x7fb008071470 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 -- start start 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc4066960 0x7efcc40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcc406b680 0x7efcc41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 0x7efcc4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc41fbed0 con 0x7efcc40c7120 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc414fff0 con 0x7efcc406b680 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc98b0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc41502d0 con 0x7efcc4066960 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 0x7efcc4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc88ae700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc4066960 0x7efcc40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 0x7efcc4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48818/0 (socket says 172.21.15.88:48818) 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 -- 172.21.15.88:0/2633736487 learned_addr learned my addr 172.21.15.88:0/2633736487 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00cc86700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 0x7fb0080c8e70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cb40 tx=0x7fb00000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000a7b0 con 0x7fb008071470 2024-09-13T18:05:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc3fff700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcc406b680 0x7efcc41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/1145148760 shutdown_connections 2024-09-13T18:05:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/1145148760 >> v2:172.21.15.94:3300/0 conn(0x7fa6a80719b0 0x7fa6a81571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/1145148760 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a80c5090 0x7fa6a8071470 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/1145148760 >> 172.21.15.88:0/1145148760 conn(0x7fa6a80664b0 msgr2=0x7fa6a806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 -- start start 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c47c0 0x7f1a3c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c157250 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1f7440 con 0x7f1a3c0c47c0 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c157c30 con 0x7f1a3c150ef0 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48826/0 (socket says 172.21.15.88:48826) 2024-09-13T18:05:38.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 -- 172.21.15.88:0/1893842957 learned_addr learned my addr 172.21.15.88:0/1893842957 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/1145148760 shutdown_connections 2024-09-13T18:05:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3a7fc700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c47c0 0x7f1a3c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 Processor -- start 2024-09-13T18:05:38.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- start start 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 -- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc4066960 msgr2=0x7efcc40cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efcc4066960 0x7efcc40cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 -- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcc406b680 msgr2=0x7efcc41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efcc406b680 0x7efcc41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7efcc90af700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcbc009b30 con 0x7efcc40c7120 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 -- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 msgr2=0x7f1a3c06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c06ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 -- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c47c0 msgr2=0x7f1a3c06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c47c0 0x7f1a3c06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7f1a3affd700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009a70 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/1145148760 wait complete. 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb008155dc0 con 0x7fb008071470 2024-09-13T18:05:38.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0081ee9a0 con 0x7fb008071470 2024-09-13T18:05:38.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00000a910 con 0x7fb008071470 2024-09-13T18:05:38.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc594066960 0x7fc5940c3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59406b680 0x7fc594147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5941559d0 0x7fc594147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc594149200 con 0x7fc59406b680 2024-09-13T18:05:38.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5941500c0 con 0x7fc5941559d0 2024-09-13T18:05:38.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.508+0000 7fc5988cc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5941f1d70 con 0x7fc594066960 2024-09-13T18:05:38.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00000acc0 con 0x7fb008071470 2024-09-13T18:05:38.536 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a3affd700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c159160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00b4a0 tx=0x7f1a2c00b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc7df59e700 1 -- 172.21.15.88:0/2472346465 shutdown_connections 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c011830 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0119b0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c011d60 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c1f6830 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafe8000fc0 con 0x7fb008071470 2024-09-13T18:05:38.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c1f6df0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc592d9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc594066960 0x7fc5940c3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5941559d0 0x7fc594147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7efcc90af700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 0x7efcc4151c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcb400b410 tx=0x7efcb400b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc592d9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc594066960 0x7fc5940c3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:39950/0 (socket says 172.21.15.88:39950) 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc592d9d700 1 -- 172.21.15.88:0/63187343 learned_addr learned my addr 172.21.15.88:0/63187343 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 -- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc594066960 msgr2=0x7fc5940c3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc594066960 0x7fc5940c3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 -- 172.21.15.88:0/63187343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59406b680 msgr2=0x7fc594147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc59406b680 0x7fc594147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c009a70 con 0x7fc5941559d0 2024-09-13T18:05:38.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc59359e700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5941559d0 0x7fc594147770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc58c014000 tx=0x7fc58c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc7df59e700 1 -- 172.21.15.88:0/2472346465 wait complete. 2024-09-13T18:05:38.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb00001b3b0 con 0x7fb008071470 2024-09-13T18:05:38.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fafec066780 0x7fafec068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fa6ad8ae700 1 Processor -- start 2024-09-13T18:05:38.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a3c147ae0 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c004920 con 0x7fc5941559d0 2024-09-13T18:05:38.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5941f2010 con 0x7fc5941559d0 2024-09-13T18:05:38.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59414f790 con 0x7fc5941559d0 2024-09-13T18:05:38.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c003e50 con 0x7fc5941559d0 2024-09-13T18:05:38.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c012670 con 0x7fc5941559d0 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc7df59e700 1 Processor -- start 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc7df59e700 1 -- start start 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4011830 con 0x7efcc40c7120 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb40119b0 con 0x7efcc40c7120 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcc41505b0 con 0x7efcc40c7120 2024-09-13T18:05:38.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fa6ad8ae700 1 -- start start 2024-09-13T18:05:38.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcc4150b70 con 0x7efcc40c7120 2024-09-13T18:05:38.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a2c01a400 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc574000fc0 con 0x7fc5941559d0 2024-09-13T18:05:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 0x7fc7e0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcc4071d90 con 0x7efcc40c7120 2024-09-13T18:05:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc7e014f180 0x7fc7e0148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.544 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 Processor -- start 2024-09-13T18:05:38.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7e01491f0 0x7fc7e014a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152220 con 0x7fc7e006c580 2024-09-13T18:05:38.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0149670 con 0x7fc7e01491f0 2024-09-13T18:05:38.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e0152d40 con 0x7fc7e014f180 2024-09-13T18:05:38.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a240668e0 0x7f1a24068da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 0x7fa6a815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a80719b0 0x7fa6a80c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a80c5090 0x7fa6a814c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a815a7b0 con 0x7fa6a806c170 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0000842b0 con 0x7fb008071470 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7fafec06e830 0x7fafec070c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafec071300 con 0x7fafec06e830 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0000846d0 con 0x7fb008071470 2024-09-13T18:05:38.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.512+0000 7fb00dc88700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7fafec06e830 0x7fafec070c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81f3710 con 0x7fa6a80719b0 2024-09-13T18:05:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6a81f3c20 con 0x7fa6a80c5090 2024-09-13T18:05:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fb00d487700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fafec066780 0x7fafec068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 -- start start 2024-09-13T18:05:38.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a2c084270 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb4011d60 con 0x7efcc40c7120 2024-09-13T18:05:38.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 0x7fc7e0146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f1a2406ea80 0x7f1a24070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a24071550 con 0x7f1a2406ea80 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2c086850 con 0x7f1a3c0c20d0 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 0x7fa6a815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc58c019030 con 0x7fc5941559d0 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 0x7fa6a815a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48854/0 (socket says 172.21.15.88:48854) 2024-09-13T18:05:38.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 -- 172.21.15.88:0/488361080 learned_addr learned my addr 172.21.15.88:0/488361080 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6a7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a80719b0 0x7fa6a80c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7ded9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7e01491f0 0x7fc7e014a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 0x7fc7e0146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48846/0 (socket says 172.21.15.88:48846) 2024-09-13T18:05:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 -- 172.21.15.88:0/1616766986 learned_addr learned my addr 172.21.15.88:0/1616766986 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a3a7fc700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a240668e0 0x7f1a24068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad0ad700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a80c5090 0x7fa6a814c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f1a2406ea80 0x7f1a24070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 -- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc7e014f180 msgr2=0x7fc7e0148cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc7e014f180 0x7fc7e0148cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 -- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7e01491f0 msgr2=0x7fc7e014a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc7e01491f0 0x7fc7e014a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d8009b30 con 0x7fc7e006c580 2024-09-13T18:05:38.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fb00d487700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fafec066780 0x7fafec068c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb004009730 tx=0x7fb004006c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc580066730 0x7fc580068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc58c086140 con 0x7fc5941559d0 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7fc58006e950 0x7fc580070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 -- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a80c5090 msgr2=0x7fa6a814c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa6a80c5090 0x7fa6a814c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 -- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a80719b0 msgr2=0x7fa6a80c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6a80719b0 0x7fa6a80c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698009570 con 0x7fa6a806c170 2024-09-13T18:05:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 Processor -- start 2024-09-13T18:05:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc580071420 con 0x7fc58006e950 2024-09-13T18:05:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc58c088760 con 0x7fc5941559d0 2024-09-13T18:05:38.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc592d9d700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc580066730 0x7fc580068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a3a7fc700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a240668e0 0x7f1a24068da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0717c0 tx=0x7f1a300092e0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc59259c700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7fc58006e950 0x7fc580070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fb00dc88700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7fafec06e830 0x7fafec070c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7de59c700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 0x7fc7e0146c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c780 tx=0x7fc7d400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ac8ac700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 0x7fa6a815a270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000cc50 tx=0x7fa6a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae480717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae48155480 con 0x7fae48071d10 2024-09-13T18:05:38.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae48155760 con 0x7fae4814f0f0 2024-09-13T18:05:38.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae4d93d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48158550 con 0x7fae48154f60 2024-09-13T18:05:38.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 -- start start 2024-09-13T18:05:38.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a3b7fe700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f1a2406ea80 0x7f1a24070ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae46ffd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fae4814f0f0 0x7fae48158c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:50790/0 (socket says 172.21.15.88:50790) 2024-09-13T18:05:38.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae46ffd700 1 -- 172.21.15.88:0/2475489095 learned_addr learned my addr 172.21.15.88:0/2475489095 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae477fe700 1 --1- 172.21.15.88:0/2475489095 >> v1:172.21.15.88:6789/0 conn(0x7fae48071d10 0x7fae480c63a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54642/0 (socket says 172.21.15.88:54642) 2024-09-13T18:05:38.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400e890 con 0x7fc7e006c580 2024-09-13T18:05:38.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d400ea10 con 0x7fc7e006c580 2024-09-13T18:05:38.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400edc0 con 0x7fc7e006c580 2024-09-13T18:05:38.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e0151f40 con 0x7fc7e006c580 2024-09-13T18:05:38.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae467fc700 1 --2- 172.21.15.88:0/2475489095 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae480717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e00ca720 con 0x7fc7e006c580 2024-09-13T18:05:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc59259c700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7fc58006e950 0x7fc580070d70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== osd.0 v2:172.21.15.88:6800/3777001302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fafec071300 con 0x7fafec06e830 2024-09-13T18:05:38.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fc592d9d700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc580066730 0x7fc580068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc5840014a0 tx=0x7fc584001430 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a000aad0 con 0x7fa6a806c170 2024-09-13T18:05:38.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae45ffb700 1 -- 172.21.15.88:0/2475489095 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942143506 0 0) 0x7fae48155760 con 0x7fae4814f0f0 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6a000ac30 con 0x7fa6a806c170 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6a814bca0 con 0x7fa6a806c170 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6a80c8930 con 0x7fa6a806c170 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae45ffb700 1 -- 172.21.15.88:0/2475489095 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae300035d0 con 0x7fae4814f0f0 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae467fc700 1 -- 172.21.15.88:0/2475489095 >> v1:172.21.15.94:6789/0 conn(0x7fae4814f0f0 legacy=0x7fae48158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae467fc700 1 -- 172.21.15.88:0/2475489095 >> v1:172.21.15.88:6789/0 conn(0x7fae48071d10 legacy=0x7fae480c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae467fc700 1 -- 172.21.15.88:0/2475489095 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48155a40 con 0x7fae48154f60 2024-09-13T18:05:38.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7fae467fc700 1 --2- 172.21.15.88:0/2475489095 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae480717d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae38009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7c6b239aca5aa68 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== osd.6 v2:172.21.15.94:6824/1539943625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1a24071550 con 0x7f1a2406ea80 2024-09-13T18:05:38.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7efcb401a400 con 0x7efcc40c7120 2024-09-13T18:05:38.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7efcb0066780 0x7efcb0068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7e0072070 con 0x7fc7e006c580 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcb4084560 con 0x7efcc40c7120 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc88ae700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7efcb0066780 0x7efcb0068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7efcb006e9a0 0x7efcb0070dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efcb0071470 con 0x7efcb006e9a0 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efcb4084a00 con 0x7efcc40c7120 2024-09-13T18:05:38.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15d3f0 con 0x7f698c0c5c30 2024-09-13T18:05:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== osd.5 v2:172.21.15.94:6816/2317600927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc580071420 con 0x7fc58006e950 2024-09-13T18:05:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f698c15c590 con 0x7f698c06e410 2024-09-13T18:05:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f699280a700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c15c870 con 0x7f698c152f10 2024-09-13T18:05:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f698bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f698bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:39988/0 (socket says 172.21.15.88:39988) 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.516+0000 7f698bfff700 1 -- 172.21.15.88:0/2225263294 learned_addr learned my addr 172.21.15.88:0/2225263294 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698bfff700 1 -- 172.21.15.88:0/2225263294 >> v1:172.21.15.94:6789/0 conn(0x7f698c06e410 legacy=0x7f698c0717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698bfff700 1 -- 172.21.15.88:0/2225263294 >> v1:172.21.15.88:6789/0 conn(0x7f698c0c5c30 legacy=0x7f698c163880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698bfff700 1 -- 172.21.15.88:0/2225263294 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c15cb50 con 0x7f698c152f10 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc3fff700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7efcb006e9a0 0x7efcb0070dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698bfff700 1 --2- 172.21.15.88:0/2225263294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6980009940 tx=0x7f6980009c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426c90444135ca63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6a0012420 con 0x7fa6a806c170 2024-09-13T18:05:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6a814bb20 con 0x7fa6a806c170 2024-09-13T18:05:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698affd700 1 -- 172.21.15.88:0/2225263294 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6980004230 con 0x7f698c152f10 2024-09-13T18:05:38.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698affd700 1 -- 172.21.15.88:0/2225263294 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6980009e90 con 0x7f698c152f10 2024-09-13T18:05:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc3fff700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7efcb006e9a0 0x7efcb0070dc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f698affd700 1 -- 172.21.15.88:0/2225263294 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69800045b0 con 0x7f698c152f10 2024-09-13T18:05:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc7d400f460 con 0x7fc7e006c580 2024-09-13T18:05:38.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc7c0066730 0x7fc7c0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f699280a700 1 -- 172.21.15.88:0/2225263294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 msgr2=0x7f698c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f699280a700 1 --2- 172.21.15.88:0/2225263294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6980009940 tx=0x7f6980009c50 comp rx=0 tx=0).stop 2024-09-13T18:05:38.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa6a0012600 con 0x7fa6a806c170 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7d40842b0 con 0x7fc7e006c580 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ddd9b700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc7c0066730 0x7fc7c0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7fc7c006e950 0x7fc7c0070d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7c0071420 con 0x7fc7c006e950 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7d40868d0 con 0x7fc7e006c580 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ded9d700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7fc7c006e950 0x7fc7c0070d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa694066730 0x7fa694068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6a0084640 con 0x7fa6a806c170 2024-09-13T18:05:38.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a7fff700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa694066730 0x7fa694068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== osd.7 v2:172.21.15.94:6808/594133881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7efcb0071470 con 0x7efcb006e9a0 2024-09-13T18:05:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fa69406e7e0 0x7fa694070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6940712b0 con 0x7fa69406e7e0 2024-09-13T18:05:38.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6ad0ad700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fa69406e7e0 0x7fa694070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ddd9b700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc7c0066730 0x7fc7c0068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00c7070 tx=0x7fc7d8009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6a0086c60 con 0x7fa6a806c170 2024-09-13T18:05:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fc7ded9d700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7fc7c006e950 0x7fc7c0070d70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f699280a700 1 -- 172.21.15.88:0/2225263294 shutdown_connections 2024-09-13T18:05:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6a7fff700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa694066730 0x7fa694068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806e1b0 tx=0x7fa698008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7fa6ad0ad700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fa69406e7e0 0x7fa694070c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7fae45ffb700 1 -- 172.21.15.88:0/2475489095 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38004230 con 0x7fae48154f60 2024-09-13T18:05:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7fae45ffb700 1 -- 172.21.15.88:0/2475489095 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38004390 con 0x7fae48154f60 2024-09-13T18:05:38.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7fae45ffb700 1 -- 172.21.15.88:0/2475489095 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae380036c0 con 0x7fae48154f60 2024-09-13T18:05:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.520+0000 7f699280a700 1 --2- 172.21.15.88:0/2225263294 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c158f00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7f699280a700 1 -- 172.21.15.88:0/2225263294 >> 172.21.15.88:0/2225263294 conn(0x7f698c0ca790 msgr2=0x7f698c0caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== osd.1 v2:172.21.15.88:6824/1509066892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fc7c0071420 con 0x7fc7c006e950 2024-09-13T18:05:38.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.524+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== osd.3 v2:172.21.15.88:6808/3817728966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa6940712b0 con 0x7fa69406e7e0 2024-09-13T18:05:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.528+0000 7efcc88ae700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7efcb0066780 0x7efcb0068c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcbc015040 tx=0x7efcbc009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- 172.21.15.88:0/2475489095 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 msgr2=0x7fae480717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 --2- 172.21.15.88:0/2475489095 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae480717d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae38009b90 comp rx=0 tx=0).stop 2024-09-13T18:05:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.528+0000 7f699280a700 1 -- 172.21.15.88:0/2225263294 shutdown_connections 2024-09-13T18:05:38.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7f699280a700 1 -- 172.21.15.88:0/2225263294 wait complete. 2024-09-13T18:05:38.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- 172.21.15.88:0/2475489095 shutdown_connections 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 --2- 172.21.15.88:0/2475489095 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae480717d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- 172.21.15.88:0/2475489095 >> 172.21.15.88:0/2475489095 conn(0x7fae480ca790 msgr2=0x7fae480caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- 172.21.15.88:0/2475489095 shutdown_connections 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- 172.21.15.88:0/2475489095 wait complete. 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 Processor -- start 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.532+0000 7fae4d93d700 1 -- start start 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 0x7fae480c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae4814f0f0 0x7fae48162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae48162580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480c1030 con 0x7fae4814f0f0 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae48161bb0 con 0x7fae48071d10 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae4d93d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae48161880 con 0x7fae48154f60 2024-09-13T18:05:38.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae467fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae4814f0f0 0x7fae48162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 0x7fae480c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae477fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae48162580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 0x7fae480c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45836/0 (socket says 172.21.15.88:45836) 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 -- 172.21.15.88:0/4093335071 learned_addr learned my addr 172.21.15.88:0/4093335071 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 -- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 msgr2=0x7fae48162580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae48154f60 0x7fae48162580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 -- 172.21.15.88:0/4093335071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae4814f0f0 msgr2=0x7fae48162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae4814f0f0 0x7fae48162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 -- 172.21.15.88:0/4093335071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae380094b0 con 0x7fae48071d10 2024-09-13T18:05:38.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7fae46ffd700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 0x7fae480c9df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c4f0 tx=0x7fae3c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7f699280a700 1 Processor -- start 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.536+0000 7f699280a700 1 -- start start 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c005d90 con 0x7fae48071d10 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0070d0 con 0x7fae48071d10 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c007440 con 0x7fae48071d10 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae480c1560 con 0x7fae48071d10 2024-09-13T18:05:38.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae480c0a70 con 0x7fae48071d10 2024-09-13T18:05:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f698c06e410 0x7f698c1ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 0x7f698c1e3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c1e3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c15a0a0 con 0x7f698c06e410 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f698c1efb80 con 0x7f698c0c5c30 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f699280a700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f698c15bc10 con 0x7f698c152f10 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f698b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 0x7f698c1e3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f698b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 0x7f698c1e3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45844/0 (socket says 172.21.15.88:45844) 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f698b7fe700 1 -- 172.21.15.88:0/1975668653 learned_addr learned my addr 172.21.15.88:0/1975668653 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c1e3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f698bfff700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f698c06e410 0x7f698c1ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 -- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 msgr2=0x7f698c1e3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 0x7f698c1e3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 -- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f698c06e410 msgr2=0x7f698c1ef640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f698c06e410 0x7f698c1ef640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6980009570 con 0x7f698c152f10 2024-09-13T18:05:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f698b7fe700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f698c0c5c30 0x7f698c1e3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7f6990da7700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c1e3ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f698400c700 tx=0x7f698400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fae3c0075a0 con 0x7fae48071d10 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fae34066780 0x7fae34068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae3c083410 con 0x7fae48071d10 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae467fc700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fae34066780 0x7fae34068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.540+0000 7fae467fc700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fae34066780 0x7fae34068c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae38008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.544+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 --> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafe8002d60 con 0x7fafec06e830 2024-09-13T18:05:38.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.544+0000 7faffdffb700 1 -- 172.21.15.88:0/3552734906 <== osd.0 v2:172.21.15.88:6800/3777001302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fafe8002d60 con 0x7fafec06e830 2024-09-13T18:05:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984003e30 con 0x7f698c152f10 2024-09-13T18:05:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6984005070 con 0x7f698c152f10 2024-09-13T18:05:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f698c15be60 con 0x7f698c152f10 2024-09-13T18:05:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fae4d93d700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fae280015e0 0x7fae28003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 --> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae28006bf0 con 0x7fae280015e0 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f698c15a2b0 con 0x7f698c152f10 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7fafec06e830 msgr2=0x7fafec070c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7fafec06e830 0x7fafec070c50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fafec066780 msgr2=0x7fafec068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fafec066780 0x7fafec068c40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb004009730 tx=0x7fb004006c80 comp rx=0 tx=0).stop 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 msgr2=0x7fb0080c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 --2- 172.21.15.88:0/3552734906 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb008071470 0x7fb0080c8e70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb00000cb40 tx=0x7fb00000cb70 comp rx=0 tx=0).stop 2024-09-13T18:05:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fae477fe700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fae280015e0 0x7fae28003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 --> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6a815db70 con 0x7fa69406e7e0 2024-09-13T18:05:38.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00dc88700 1 -- 172.21.15.88:0/3552734906 reap_dead start 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 shutdown_connections 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 >> 172.21.15.88:0/3552734906 conn(0x7fb0080664b0 msgr2=0x7fb008156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 shutdown_connections 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fb00e489700 1 -- 172.21.15.88:0/3552734906 wait complete. 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fa6a57fa700 1 -- 172.21.15.88:0/488361080 <== osd.3 v2:172.21.15.88:6808/3817728966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa69c009600 con 0x7fa69406e7e0 2024-09-13T18:05:38.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fae477fe700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fae280015e0 0x7fae28003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 --> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a3c14dd80 con 0x7f1a2406ea80 2024-09-13T18:05:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6984005420 con 0x7f698c152f10 2024-09-13T18:05:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a237fe700 1 -- 172.21.15.88:0/1893842957 <== osd.6 v2:172.21.15.94:6824/1539943625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a3c14dd80 con 0x7f1a2406ea80 2024-09-13T18:05:38.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== osd.4 v2:172.21.15.94:6800/1669353113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fae28006bf0 con 0x7fae280015e0 2024-09-13T18:05:38.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f696c000fc0 con 0x7f698c152f10 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f1a2406ea80 msgr2=0x7f1a24070ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f1a2406ea80 0x7f1a24070ea0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a240668e0 msgr2=0x7f1a24068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a240668e0 0x7f1a24068da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0717c0 tx=0x7f1a300092e0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 msgr2=0x7f1a3c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/1893842957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c0c20d0 0x7f1a3c159160 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00b4a0 tx=0x7f1a2c00b7b0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/1893842957 reap_dead start 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 shutdown_connections 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 >> 172.21.15.88:0/1893842957 conn(0x7f1a3c0664b0 msgr2=0x7f1a3c14f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 shutdown_connections 2024-09-13T18:05:38.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1893842957 wait complete. 2024-09-13T18:05:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 --> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7e0071d90 con 0x7fc7c006e950 2024-09-13T18:05:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fa69406e7e0 msgr2=0x7fa694070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fa69406e7e0 0x7fa694070c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7ceffd700 1 -- 172.21.15.88:0/1616766986 <== osd.1 v2:172.21.15.88:6824/1509066892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7d0014040 con 0x7fc7c006e950 2024-09-13T18:05:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 --> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc574002d60 con 0x7fc58006e950 2024-09-13T18:05:38.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc57b7fe700 1 -- 172.21.15.88:0/63187343 <== osd.5 v2:172.21.15.94:6816/2317600927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc574002d60 con 0x7fc58006e950 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7fc58006e950 msgr2=0x7fc580070d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7fc58006e950 0x7fc580070d70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc580066730 msgr2=0x7fc580068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc580066730 0x7fc580068bf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc5840014a0 tx=0x7fc584001430 comp rx=0 tx=0).stop 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5941559d0 msgr2=0x7fc594147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 --2- 172.21.15.88:0/63187343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc5941559d0 0x7fc594147770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc58c014000 tx=0x7fc58c004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc59359e700 1 -- 172.21.15.88:0/63187343 reap_dead start 2024-09-13T18:05:38.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 shutdown_connections 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 >> 172.21.15.88:0/63187343 conn(0x7fc5940664b0 msgr2=0x7fc59406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 shutdown_connections 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc5988cc700 1 -- 172.21.15.88:0/63187343 wait complete. 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7fc7c006e950 msgr2=0x7fc7c0070d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7fc7c006e950 0x7fc7c0070d70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc7c0066730 msgr2=0x7fc7c0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc7c0066730 0x7fc7c0068bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00c7070 tx=0x7fc7d8009000 comp rx=0 tx=0).stop 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 msgr2=0x7fc7e0146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7df59e700 1 --2- 172.21.15.88:0/1616766986 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7e006c580 0x7fc7e0146c80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc7d400c780 tx=0x7fc7d400ca90 comp rx=0 tx=0).stop 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7fc7ded9d700 1 -- 172.21.15.88:0/1616766986 reap_dead start 2024-09-13T18:05:38.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 shutdown_connections 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 >> 172.21.15.88:0/1616766986 conn(0x7fc7e00664b0 msgr2=0x7fc7e00c5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa694066730 msgr2=0x7fa694068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa694066730 0x7fa694068bf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa6a806e1b0 tx=0x7fa698008030 comp rx=0 tx=0).stop 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.548+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 --> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcc4071ab0 con 0x7efcb006e9a0 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc17fa700 1 -- 172.21.15.88:0/2633736487 <== osd.7 v2:172.21.15.94:6808/594133881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efcb8009710 con 0x7efcb006e9a0 2024-09-13T18:05:38.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7efcb006e9a0 msgr2=0x7efcb0070dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7efcb006e9a0 0x7efcb0070dc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7efcb0066780 msgr2=0x7efcb0068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7efcb0066780 0x7efcb0068c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efcbc015040 tx=0x7efcbc009000 comp rx=0 tx=0).stop 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 msgr2=0x7efcc4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 --2- 172.21.15.88:0/2633736487 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efcc40c7120 0x7efcc4151c20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efcb400b410 tx=0x7efcb400b720 comp rx=0 tx=0).stop 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc90af700 1 -- 172.21.15.88:0/2633736487 reap_dead start 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 shutdown_connections 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 >> 172.21.15.88:0/2633736487 conn(0x7efcc40664b0 msgr2=0x7efcc4143a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 shutdown_connections 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.552+0000 7efcc98b0700 1 -- 172.21.15.88:0/2633736487 wait complete. 2024-09-13T18:05:38.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6984005580 con 0x7f698c152f10 2024-09-13T18:05:38.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 shutdown_connections 2024-09-13T18:05:38.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fc7df59e700 1 -- 172.21.15.88:0/1616766986 wait complete. 2024-09-13T18:05:38.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6978066800 0x7f6978068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6984083700 con 0x7f698c152f10 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7f697806e8b0 0x7f6978070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6978071380 con 0x7f697806e8b0 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6984085d20 con 0x7f698c152f10 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 msgr2=0x7fa6a815a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 --2- 172.21.15.88:0/488361080 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa6a806c170 0x7fa6a815a270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6a000cc50 tx=0x7fa6a000cf60 comp rx=0 tx=0).stop 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad0ad700 1 -- 172.21.15.88:0/488361080 reap_dead start 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 shutdown_connections 2024-09-13T18:05:38.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 >> 172.21.15.88:0/488361080 conn(0x7fa6a80664b0 msgr2=0x7fa6a815b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f698b7fe700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7f697806e8b0 0x7f6978070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 shutdown_connections 2024-09-13T18:05:38.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7fa6ad8ae700 1 -- 172.21.15.88:0/488361080 wait complete. 2024-09-13T18:05:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f698b7fe700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7f697806e8b0 0x7f6978070cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.556+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== osd.2 v2:172.21.15.88:6816/3613472173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f6978071380 con 0x7f697806e8b0 2024-09-13T18:05:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.564+0000 7f698bfff700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6978066800 0x7f6978068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.564+0000 7f698bfff700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6978066800 0x7f6978068cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6980009890 tx=0x7f6980008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.600 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-09-13T18:05:38.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:05:38.601 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:38.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:05:38.602 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:38.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:05:38.603 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:38.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:05:38.604 INFO:teuthology.orchestra.run.smithi088.stdout:64424509447 2024-09-13T18:05:38.604 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:05:38.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 --> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae28005cd0 con 0x7fae280015e0 2024-09-13T18:05:38.605 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-09-13T18:05:38.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:05:38.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae2ffff700 1 -- 172.21.15.88:0/4093335071 <== osd.4 v2:172.21.15.94:6800/1669353113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae28005cd0 con 0x7fae280015e0 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fae280015e0 msgr2=0x7fae28003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fae280015e0 0x7fae28003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fae34066780 msgr2=0x7fae34068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fae34066780 0x7fae34068c40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae38009880 tx=0x7fae38008030 comp rx=0 tx=0).stop 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 msgr2=0x7fae480c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 --2- 172.21.15.88:0/4093335071 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae48071d10 0x7fae480c9df0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c4f0 tx=0x7fae3c00c800 comp rx=0 tx=0).stop 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae477fe700 1 -- 172.21.15.88:0/4093335071 reap_dead start 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 shutdown_connections 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 >> 172.21.15.88:0/4093335071 conn(0x7fae480ca790 msgr2=0x7fae48157150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 shutdown_connections 2024-09-13T18:05:38.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.576+0000 7fae4d93d700 1 -- 172.21.15.88:0/4093335071 wait complete. 2024-09-13T18:05:38.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 --> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f696c002d60 con 0x7f697806e8b0 2024-09-13T18:05:38.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f6988ff9700 1 -- 172.21.15.88:0/1975668653 <== osd.2 v2:172.21.15.88:6816/3613472173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f696c002d60 con 0x7f697806e8b0 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7f697806e8b0 msgr2=0x7f6978070cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7f697806e8b0 0x7f6978070cd0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6978066800 msgr2=0x7f6978068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6978066800 0x7f6978068cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6980009890 tx=0x7f6980008030 comp rx=0 tx=0).stop 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 msgr2=0x7f698c1e3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 --2- 172.21.15.88:0/1975668653 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f698c152f10 0x7f698c1e3ac0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f698400c700 tx=0x7f698400ca10 comp rx=0 tx=0).stop 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f6990da7700 1 -- 172.21.15.88:0/1975668653 reap_dead start 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 shutdown_connections 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 >> 172.21.15.88:0/1975668653 conn(0x7f698c0ca790 msgr2=0x7f698c151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 shutdown_connections 2024-09-13T18:05:38.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.580+0000 7f699280a700 1 -- 172.21.15.88:0/1975668653 wait complete. 2024-09-13T18:05:38.610 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:38.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:05:38.611 INFO:teuthology.orchestra.run.smithi088.stdout:64424509447 2024-09-13T18:05:38.612 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:05:38.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.788+0000 7f09425e5700 1 Processor -- start 2024-09-13T18:05:38.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.788+0000 7f09425e5700 1 -- start start 2024-09-13T18:05:38.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 Processor -- start 2024-09-13T18:05:38.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 -- start start 2024-09-13T18:05:38.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f093c06b680 0x7f093c1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f093c06c580 0x7f093c06c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c155f10 con 0x7f093c14f180 2024-09-13T18:05:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c06c0f0 con 0x7f093c06b680 2024-09-13T18:05:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c0c1890 con 0x7f093c06c580 2024-09-13T18:05:38.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f093c14f180 0x7f093c0c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54664/0 (socket says 172.21.15.88:54664) 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093bfff700 1 -- 172.21.15.88:0/3164395140 learned_addr learned my addr 172.21.15.88:0/3164395140 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 --2- 172.21.15.88:0/3164395140 >> v2:172.21.15.88:3300/0 conn(0x7f093c06b680 0x7f093c1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f0940b82700 1 --2- 172.21.15.88:0/3164395140 >> v2:172.21.15.94:3300/0 conn(0x7f093c06c580 0x7f093c06c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 -- 172.21.15.88:0/3164395140 >> v2:172.21.15.94:3300/0 conn(0x7f093c06c580 msgr2=0x7f093c06c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 --2- 172.21.15.88:0/3164395140 >> v2:172.21.15.94:3300/0 conn(0x7f093c06c580 0x7f093c06c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 -- 172.21.15.88:0/3164395140 >> v1:172.21.15.88:6789/0 conn(0x7f093c14f180 legacy=0x7f093c0c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 -- 172.21.15.88:0/3164395140 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0717d0 con 0x7f093c06b680 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 0x7ff664071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66415e370 con 0x7ff6640719b0 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6640c1660 con 0x7ff66406c170 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff669508700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66415df50 con 0x7ff6640c5090 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6637fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff6640719b0 0x7ff6641571b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54666/0 (socket says 172.21.15.88:54666) 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6637fe700 1 -- 172.21.15.88:0/2239771758 learned_addr learned my addr 172.21.15.88:0/2239771758 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6627fc700 1 --2- 172.21.15.88:0/2239771758 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 0x7ff664071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 Processor -- start 2024-09-13T18:05:38.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093b7fe700 1 --2- 172.21.15.88:0/3164395140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c06b680 0x7f093c1559d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f093c0c8540 tx=0x7f092c00bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f508c2ae5033943 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 Processor -- start 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff661ffb700 1 -- 172.21.15.88:0/2239771758 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606762056 0 0) 0x7ff66415e370 con 0x7ff6640719b0 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff661ffb700 1 -- 172.21.15.88:0/2239771758 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff64c0035d0 con 0x7ff6640719b0 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6627fc700 1 -- 172.21.15.88:0/2239771758 >> v1:172.21.15.94:6789/0 conn(0x7ff66406c170 legacy=0x7ff66406c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6627fc700 1 -- 172.21.15.88:0/2239771758 >> v1:172.21.15.88:6789/0 conn(0x7ff6640719b0 legacy=0x7ff6641571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6627fc700 1 -- 172.21.15.88:0/2239771758 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66415d5b0 con 0x7ff6640c5090 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 -- start start 2024-09-13T18:05:38.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff6627fc700 1 --2- 172.21.15.88:0/2239771758 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 0x7ff664071470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff658009880 tx=0x7ff658009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c654faa8d1077c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff661ffb700 1 -- 172.21.15.88:0/2239771758 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658004230 con 0x7ff6640c5090 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff661ffb700 1 -- 172.21.15.88:0/2239771758 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658004390 con 0x7ff6640c5090 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7ff661ffb700 1 -- 172.21.15.88:0/2239771758 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6580036c0 con 0x7ff6640c5090 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f7c5759e700 1 Processor -- start 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f7c5759e700 1 -- start start 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 0x7f7c5814fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7c580c1570 0x7f7c5814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5806ce90 con 0x7f7c5806bfd0 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5806d170 con 0x7f7c58155ba0 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5806d450 con 0x7f7c580c1570 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f55bc06c170 0x7f55bc06c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc15e370 con 0x7f55bc06ca90 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc15df50 con 0x7f55bc06c170 2024-09-13T18:05:38.801 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c30a2700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc15d3a0 con 0x7f55bc0c5090 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093affd700 1 -- 172.21.15.88:0/3164395140 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c006d30 con 0x7f093c06b680 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093affd700 1 -- 172.21.15.88:0/3164395140 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c006e90 con 0x7f093c06b680 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f093affd700 1 -- 172.21.15.88:0/3164395140 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00ca20 con 0x7f093c06b680 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- 172.21.15.88:0/3164395140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c06b680 msgr2=0x7f093c1559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 --2- 172.21.15.88:0/3164395140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c06b680 0x7f093c1559d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f093c0c8540 tx=0x7f092c00bbf0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- 172.21.15.88:0/3164395140 shutdown_connections 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 --2- 172.21.15.88:0/3164395140 >> v2:172.21.15.94:3300/0 conn(0x7f093c06c580 0x7f093c06c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 --2- 172.21.15.88:0/3164395140 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c06b680 0x7f093c1559d0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f093c0c8540 tx=0x7f092c00bbf0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f09425e5700 1 -- 172.21.15.88:0/3164395140 >> 172.21.15.88:0/3164395140 conn(0x7f093c0664b0 msgr2=0x7f093c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- 172.21.15.88:0/3164395140 shutdown_connections 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 -- start start 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 0x7fb760071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 0x7fb7601571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76015df50 con 0x7fb7600719b0 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76015d3a0 con 0x7fb76006ca90 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb7685ec700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76015e370 con 0x7fb76006c170 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb766388700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb766388700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:40018/0 (socket says 172.21.15.88:40018) 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7fb766388700 1 -- 172.21.15.88:0/2600149319 learned_addr learned my addr 172.21.15.88:0/2600149319 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766b89700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 0x7fb7601571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb765b87700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 0x7fb760071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 -- 172.21.15.88:0/2600149319 >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 msgr2=0x7fb760071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- 172.21.15.88:0/3164395140 wait complete. 2024-09-13T18:05:38.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- 172.21.15.88:0/2239771758 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 msgr2=0x7ff664071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 --2- 172.21.15.88:0/2239771758 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 0x7ff664071470 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff658009880 tx=0x7ff658009b90 comp rx=0 tx=0).stop 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55bbfff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f55bc06ca90 0x7f55bc071470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:50834/0 (socket says 172.21.15.88:50834) 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55bbfff700 1 -- 172.21.15.88:0/4130279312 learned_addr learned my addr 172.21.15.88:0/4130279312 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.792+0000 7f55c0e3e700 1 --2- 172.21.15.88:0/4130279312 >> v2:172.21.15.88:3300/0 conn(0x7f55bc06c170 0x7f55bc06c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55bb7fe700 1 -- 172.21.15.88:0/4130279312 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003931802 0 0) 0x7f55bc15e370 con 0x7f55bc06ca90 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c0e3e700 1 -- 172.21.15.88:0/4130279312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 msgr2=0x7f55bc1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c0e3e700 1 --2- 172.21.15.88:0/4130279312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c0e3e700 1 -- 172.21.15.88:0/4130279312 >> v1:172.21.15.94:6789/0 conn(0x7f55bc06ca90 legacy=0x7f55bc071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c0e3e700 1 -- 172.21.15.88:0/4130279312 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc0c1660 con 0x7f55bc06c170 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 0x7f7c5814fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c55d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 0x7f7c5814fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48906/0 (socket says 172.21.15.88:48906) 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c55d9b700 1 -- 172.21.15.88:0/768552076 learned_addr learned my addr 172.21.15.88:0/768552076 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/768552076 >> v2:172.21.15.94:3300/0 conn(0x7f7c580c1570 0x7f7c5814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 -- 172.21.15.88:0/768552076 >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 msgr2=0x7f7c5814fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/768552076 >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 0x7f7c5814fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 -- 172.21.15.88:0/768552076 >> v1:172.21.15.88:6789/0 conn(0x7f7c5806bfd0 legacy=0x7f7c5806c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 -- 172.21.15.88:0/768552076 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5806d730 con 0x7f7c580c1570 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 0x7fb760071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 -- 172.21.15.88:0/2600149319 >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 msgr2=0x7fb7601571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 0x7fb7601571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 -- 172.21.15.88:0/2600149319 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600c1660 con 0x7fb76006c170 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- 172.21.15.88:0/2239771758 shutdown_connections 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 --2- 172.21.15.88:0/2239771758 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6640c5090 0x7ff664071470 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- 172.21.15.88:0/2239771758 >> 172.21.15.88:0/2239771758 conn(0x7ff6640664b0 msgr2=0x7ff66406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/768552076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c580c1570 0x7f7c5814ff80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c58070b10 tx=0x7f7c4800df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f859c2fbb8bd21ba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- 172.21.15.88:0/2239771758 shutdown_connections 2024-09-13T18:05:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- 172.21.15.88:0/2239771758 wait complete. 2024-09-13T18:05:38.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c0e3e700 1 --2- 172.21.15.88:0/4130279312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06c170 0x7f55bc06c550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009850 tx=0x7f55ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41a5e3e2ddc5190 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766b89700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 0x7fb7601571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb765b87700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 0x7fb760071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb766388700 1 --2- 172.21.15.88:0/2600149319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb760072a30 tx=0x7fb75800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3432fcae2e0acd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55bb7fe700 1 -- 172.21.15.88:0/4130279312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011830 con 0x7f55bc06c170 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55bb7fe700 1 -- 172.21.15.88:0/4130279312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac011990 con 0x7f55bc06c170 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55bb7fe700 1 -- 172.21.15.88:0/4130279312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac011830 con 0x7f55bc06c170 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb765386700 1 -- 172.21.15.88:0/2600149319 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800e070 con 0x7fb76006c170 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 Processor -- start 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb765386700 1 -- 172.21.15.88:0/2600149319 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75800b9c0 con 0x7fb76006c170 2024-09-13T18:05:38.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb765386700 1 -- 172.21.15.88:0/2600149319 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800bd50 con 0x7fb76006c170 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 -- 172.21.15.88:0/4130279312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06c170 msgr2=0x7f55bc06c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 --2- 172.21.15.88:0/4130279312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06c170 0x7f55bc06c550 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009850 tx=0x7f55ac009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 -- 172.21.15.88:0/4130279312 shutdown_connections 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 --2- 172.21.15.88:0/4130279312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 --2- 172.21.15.88:0/4130279312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06c170 0x7f55bc06c550 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 -- 172.21.15.88:0/4130279312 >> 172.21.15.88:0/4130279312 conn(0x7f55bc0664b0 msgr2=0x7f55bc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 Processor -- start 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5559a700 1 -- 172.21.15.88:0/768552076 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800f8a0 con 0x7f7c580c1570 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5559a700 1 -- 172.21.15.88:0/768552076 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800fa00 con 0x7f7c580c1570 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5559a700 1 -- 172.21.15.88:0/768552076 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4800fd90 con 0x7f7c580c1570 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- 172.21.15.88:0/768552076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c580c1570 msgr2=0x7f7c5814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 --2- 172.21.15.88:0/768552076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c580c1570 0x7f7c5814ff80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c58070b10 tx=0x7f7c4800df50 comp rx=0 tx=0).stop 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- start start 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f093c06c580 0x7f093c0c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f093c0bb3f0 0x7f093c0b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1eadf0 con 0x7f093c14f180 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c0b9320 con 0x7f093c0bb3f0 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f09425e5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1ea870 con 0x7f093c06c580 2024-09-13T18:05:38.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7ff669508700 1 -- start start 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48918/0 (socket says 172.21.15.88:48918) 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f093b7fe700 1 -- 172.21.15.88:0/2196575171 learned_addr learned my addr 172.21.15.88:0/2196575171 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f093bfff700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f093c06c580 0x7f093c0c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f0940b82700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f093c0bb3f0 0x7f093c0b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f55c30a2700 1 -- 172.21.15.88:0/4130279312 shutdown_connections 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb7685ec700 1 -- 172.21.15.88:0/2600149319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 msgr2=0x7fb76006c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7fb7685ec700 1 --2- 172.21.15.88:0/2600149319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb760072a30 tx=0x7fb75800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 -- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f093c06c580 msgr2=0x7f093c0c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f093c06c580 0x7f093c0c0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 -- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f093c0bb3f0 msgr2=0x7f093c0b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.815 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f093c0bb3f0 0x7f093c0b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 -- 172.21.15.88:0/2196575171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c00b570 con 0x7f093c14f180 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f093b7fe700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f092c014000 tx=0x7f092c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- 172.21.15.88:0/768552076 shutdown_connections 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 --2- 172.21.15.88:0/768552076 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c580c1570 0x7f7c5814ff80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff66406c170 0x7ff6641f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.816 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 --2- 172.21.15.88:0/768552076 >> v2:172.21.15.88:3300/0 conn(0x7f7c58155ba0 0x7f7c5814fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.796+0000 7f7c5759e700 1 -- 172.21.15.88:0/768552076 >> 172.21.15.88:0/768552076 conn(0x7f7c580664b0 msgr2=0x7f7c5806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f7c5759e700 1 -- 172.21.15.88:0/768552076 shutdown_connections 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f7c5759e700 1 -- 172.21.15.88:0/768552076 wait complete. 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6640c5090 0x7ff66414c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.817 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff664153760 con 0x7ff6640c5090 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66415a8b0 con 0x7ff6640719b0 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6641f5bb0 con 0x7ff66406c170 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c01b070 con 0x7f093c14f180 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 -- 172.21.15.88:0/2600149319 shutdown_connections 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.88:3300/0 conn(0x7fb7600719b0 0x7fb7601571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.818 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 --2- 172.21.15.88:0/2600149319 >> v2:172.21.15.94:3300/0 conn(0x7fb76006ca90 0x7fb760071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 --2- 172.21.15.88:0/2600149319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb76006c170 0x7fb76006c550 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 -- 172.21.15.88:0/2600149319 >> 172.21.15.88:0/2600149319 conn(0x7fb7600664b0 msgr2=0x7fb76006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c01c040 con 0x7f093c14f180 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c003900 con 0x7f093c14f180 2024-09-13T18:05:38.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45880/0 (socket says 172.21.15.88:45880) 2024-09-13T18:05:38.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 -- 172.21.15.88:0/931669856 learned_addr learned my addr 172.21.15.88:0/931669856 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f09425e5700 1 -- 172.21.15.88:0/2196575171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c1eab10 con 0x7f093c14f180 2024-09-13T18:05:38.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f09425e5700 1 -- 172.21.15.88:0/2196575171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c0b8cd0 con 0x7f093c14f180 2024-09-13T18:05:38.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 -- 172.21.15.88:0/4130279312 wait complete. 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 Processor -- start 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 -- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff66406c170 msgr2=0x7ff6641f6600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff66406c170 0x7ff6641f6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 -- 172.21.15.88:0/931669856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6640c5090 msgr2=0x7ff66414c620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6640c5090 0x7ff66414c620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 -- 172.21.15.88:0/931669856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580094b0 con 0x7ff6640719b0 2024-09-13T18:05:38.821 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 -- start start 2024-09-13T18:05:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 -- 172.21.15.88:0/2600149319 shutdown_connections 2024-09-13T18:05:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7fb7685ec700 1 -- 172.21.15.88:0/2600149319 wait complete. 2024-09-13T18:05:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 Processor -- start 2024-09-13T18:05:38.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 -- start start 2024-09-13T18:05:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f7c5759e700 1 Processor -- start 2024-09-13T18:05:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06ca90 0x7f55bc0c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55bc150010 0x7f55bc1fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.823 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f7c5759e700 1 -- start start 2024-09-13T18:05:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0c3310 con 0x7f55bc06ca90 2024-09-13T18:05:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc1fb530 con 0x7f55bc150010 2024-09-13T18:05:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c30a2700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc14ea10 con 0x7f55bc0c5090 2024-09-13T18:05:38.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f092c003a60 con 0x7f093c14f180 2024-09-13T18:05:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:40046/0 (socket says 172.21.15.88:40046) 2024-09-13T18:05:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 -- 172.21.15.88:0/69630451 learned_addr learned my addr 172.21.15.88:0/69630451 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55c163f700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55bc150010 0x7f55bc1fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f61840c5300 0x7f61840c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618406cbf0 con 0x7f6184153320 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618406c070 con 0x7f61840c56e0 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618b2cc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618406fc00 con 0x7f61840c5300 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618aacb700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6184153320 0x7f6184159070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54686/0 (socket says 172.21.15.88:54686) 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f618aacb700 1 -- 172.21.15.88:0/3972446724 learned_addr learned my addr 172.21.15.88:0/3972446724 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 Processor -- start 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff6627fc700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658006ea0 con 0x7ff6640719b0 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 -- 172.21.15.88:0/931669856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6641f6170 con 0x7ff6640719b0 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 -- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55bc150010 msgr2=0x7f55bc1fbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55bc150010 0x7f55bc1fbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 -- 172.21.15.88:0/69630451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06ca90 msgr2=0x7f55bc0c4140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7ff669508700 1 -- 172.21.15.88:0/931669856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66415cda0 con 0x7ff6640719b0 2024-09-13T18:05:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06ca90 0x7f55bc0c4140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.800+0000 7f55bbfff700 1 -- 172.21.15.88:0/69630451 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0094b0 con 0x7f55bc0c5090 2024-09-13T18:05:38.828 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 -- start start 2024-09-13T18:05:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c5806bfd0 0x7f7c580c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580c1570 0x7f7c581edaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893502979 0 0) 0x7f618406cbf0 con 0x7f6184153320 2024-09-13T18:05:38.829 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61700035d0 con 0x7f6184153320 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c58149a90 con 0x7f7c580c1570 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c5110 con 0x7f7c581ee030 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5759e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c5340 con 0x7f7c5806bfd0 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55bbfff700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55b400cce0 tx=0x7f55b400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6580045d0 con 0x7ff6640719b0 2024-09-13T18:05:38.830 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658011830 con 0x7ff6640719b0 2024-09-13T18:05:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1661296535 0 0) 0x7f61700035d0 con 0x7f6184153320 2024-09-13T18:05:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 >> v2:172.21.15.88:3300/0 conn(0x7f61840c5300 msgr2=0x7f61840c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45894/0 (socket says 172.21.15.88:45894) 2024-09-13T18:05:38.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 -- 172.21.15.88:0/3595040830 learned_addr learned my addr 172.21.15.88:0/3595040830 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f0938ff9700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 0x7f0928068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f092c013070 con 0x7f093c14f180 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f093bfff700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 0x7f0928068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76006ca90 0x7fb76013e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 0x7fb760152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760153260 con 0x7fb76006ca90 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760153850 con 0x7fb76006c170 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb7685ec700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76013d5e0 con 0x7fb7600719b0 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:45910/0 (socket says 172.21.15.88:45910) 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 -- 172.21.15.88:0/3541101703 learned_addr learned my addr 172.21.15.88:0/3541101703 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766b89700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 0x7fb760152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff669508700 1 -- 172.21.15.88:0/931669856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff644005310 con 0x7ff6640719b0 2024-09-13T18:05:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f09425e5700 1 -- 172.21.15.88:0/2196575171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091c005310 con 0x7f093c14f180 2024-09-13T18:05:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb765b87700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76006ca90 0x7fb76013e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3972446724 >> v2:172.21.15.88:3300/0 conn(0x7f61840c5300 0x7f61840c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c5659c700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c5806bfd0 0x7f7c580c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c55d9b700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580c1570 0x7f7c581edaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 -- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c5806bfd0 msgr2=0x7f7c580c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c5806bfd0 0x7f7c580c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 -- 172.21.15.88:0/3595040830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580c1570 msgr2=0x7f7c581edaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580c1570 0x7f7c581edaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 --2- 172.21.15.88:0/3972446724 >> v2:172.21.15.88:3300/0 conn(0x7f61840c5300 0x7f61840c6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 -- 172.21.15.88:0/3595040830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4800d950 con 0x7f7c581ee030 2024-09-13T18:05:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 >> v1:172.21.15.94:6789/0 conn(0x7f61840c56e0 legacy=0x7f6184152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840c79f0 con 0x7f6184153320 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f7c56d9d700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806d590 tx=0x7f7c48004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff658011990 con 0x7ff6640719b0 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 -- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 msgr2=0x7fb760152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 0x7fb760152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 -- 172.21.15.88:0/3541101703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76006ca90 msgr2=0x7fb76013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76006ca90 0x7fb76013e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 -- 172.21.15.88:0/3541101703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb758009b30 con 0x7fb76006c170 2024-09-13T18:05:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766b89700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 0x7fb760152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff64b7fe700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 0x7ff650068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff658085650 con 0x7ff6640719b0 2024-09-13T18:05:38.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b400aba0 con 0x7f55bc0c5090 2024-09-13T18:05:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7fb766388700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7580042f0 tx=0x7fb758004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b400ad00 con 0x7f55bc0c5090 2024-09-13T18:05:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b4007310 con 0x7f55bc0c5090 2024-09-13T18:05:38.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff662ffd700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 0x7ff650068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc14de90 con 0x7f55bc0c5090 2024-09-13T18:05:38.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc14e450 con 0x7f55bc0c5090 2024-09-13T18:05:38.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f6180001670 con 0x7f6184153320 2024-09-13T18:05:38.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 >> v1:172.21.15.88:6789/0 conn(0x7f6184153320 legacy=0x7f6184159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6170003a20 0x7f6170003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 0x7f6170004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170005230 0x7f617000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618406fc00 con 0x7f6170003a20 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61700148e0 con 0x7f6170004870 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6170014aa0 con 0x7f6170005230 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3972446724 >> v2:172.21.15.88:3300/0 conn(0x7f61840c5300 0x7f61840c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 0x7f6170004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618aacb700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170005230 0x7f617000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6170003a20 0x7f6170003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 -- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170005230 msgr2=0x7f617000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170005230 0x7f617000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 -- 172.21.15.88:0/3972446724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6170003a20 msgr2=0x7f6170003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6170003a20 0x7f6170003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 -- 172.21.15.88:0/3972446724 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61840c79f0 con 0x7f6170004870 2024-09-13T18:05:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618aacb700 1 -- 172.21.15.88:0/3972446724 reap_dead start 2024-09-13T18:05:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f093bfff700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 0x7f0928068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09300061c0 tx=0x7f09300060d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 0x7f6170004cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61740018f0 tx=0x7f61700058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=182a47ed9f07ad97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6170003a20 0x7f6170003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.804+0000 7ff662ffd700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 0x7ff650068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff65c002080 tx=0x7ff65c001690 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 Processor -- start 2024-09-13T18:05:38.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 -- start start 2024-09-13T18:05:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 Processor -- start 2024-09-13T18:05:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 -- start start 2024-09-13T18:05:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc1fb320 con 0x7f55bc0c5090 2024-09-13T18:05:38.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f55b4007470 con 0x7f55bc0c5090 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa414150070 0x7fa4140c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 0x7fa4141568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41406cda0 con 0x7fa4140721e0 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa414155e10 con 0x7fa414150070 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa41b22e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4140c6720 con 0x7fa41406cfb0 2024-09-13T18:05:38.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c0c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa414150070 0x7fa4140c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b5c0c20d0 0x7f0b5c15a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0c69e0 con 0x7f0b5c150ef0 2024-09-13T18:05:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c4bc0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b60c5f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0c5af0 con 0x7f0b5c0c47c0 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa414150070 0x7fa4140c5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48960/0 (socket says 172.21.15.88:48960) 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 -- 172.21.15.88:0/513245201 learned_addr learned my addr 172.21.15.88:0/513245201 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55b97fa700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 0x7f55a8068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55b4084500 con 0x7f55bc0c5090 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0b5c150ef0 0x7f0b5c06d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54694/0 (socket says 172.21.15.88:54694) 2024-09-13T18:05:38.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5b7fe700 1 -- 172.21.15.88:0/1237457537 learned_addr learned my addr 172.21.15.88:0/1237457537 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa4197cb700 1 --2- 172.21.15.88:0/513245201 >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 0x7fa4141568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 --2- 172.21.15.88:0/1237457537 >> v2:172.21.15.88:3300/0 conn(0x7f0b5c0c20d0 0x7f0b5c15a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55c0e3e700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 0x7f55a8068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 -- 172.21.15.88:0/513245201 >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 msgr2=0x7fa4141568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 --2- 172.21.15.88:0/513245201 >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 0x7fa4141568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 -- 172.21.15.88:0/513245201 >> v1:172.21.15.94:6789/0 conn(0x7fa4140721e0 legacy=0x7fa41406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 -- 172.21.15.88:0/513245201 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140c6a00 con 0x7fa414150070 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5affd700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c0c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa4197cb700 1 --2- 172.21.15.88:0/513245201 >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 0x7fa4141568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 -- 172.21.15.88:0/1237457537 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 msgr2=0x7f0b5c0c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c0c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 -- 172.21.15.88:0/1237457537 >> v1:172.21.15.88:6789/0 conn(0x7f0b5c150ef0 legacy=0x7f0b5c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 -- 172.21.15.88:0/1237457537 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0c5dd0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa418fca700 1 --2- 172.21.15.88:0/513245201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa4140c5190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4140c2e80 tx=0x7fa404009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29333df32183eecd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f0b5bfff700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c15a5b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009850 tx=0x7f0b44009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eafbecf2d981e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7f55c0e3e700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 0x7f55a8068c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55ac014040 tx=0x7f55ac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.808+0000 7fa4137fe700 1 -- 172.21.15.88:0/513245201 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400b8a0 con 0x7fa414150070 2024-09-13T18:05:38.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5a7fc700 1 -- 172.21.15.88:0/1237457537 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44011830 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4137fe700 1 -- 172.21.15.88:0/513245201 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400ba00 con 0x7fa414150070 2024-09-13T18:05:38.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4137fe700 1 -- 172.21.15.88:0/513245201 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40400bd90 con 0x7fa414150070 2024-09-13T18:05:38.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5a7fc700 1 -- 172.21.15.88:0/1237457537 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44011990 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5a7fc700 1 -- 172.21.15.88:0/1237457537 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b44011d20 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f092c0528c0 con 0x7f093c14f180 2024-09-13T18:05:38.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- 172.21.15.88:0/1237457537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 msgr2=0x7f0b5c15a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c15a5b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009850 tx=0x7f0b44009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:38.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- 172.21.15.88:0/513245201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 msgr2=0x7fa4140c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- 172.21.15.88:0/513245201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa4140c5190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa4140c2e80 tx=0x7fa404009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- 172.21.15.88:0/1237457537 shutdown_connections 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c15a5b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/1237457537 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c0c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- 172.21.15.88:0/1237457537 >> 172.21.15.88:0/1237457537 conn(0x7f0b5c0664b0 msgr2=0x7f0b5c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- 172.21.15.88:0/513245201 shutdown_connections 2024-09-13T18:05:38.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- 172.21.15.88:0/513245201 >> v2:172.21.15.94:3300/0 conn(0x7fa41406cfb0 0x7fa4141568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- 172.21.15.88:0/513245201 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa4140c5190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- 172.21.15.88:0/513245201 >> 172.21.15.88:0/513245201 conn(0x7fa4140ca790 msgr2=0x7fa4140caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- 172.21.15.88:0/1237457537 shutdown_connections 2024-09-13T18:05:38.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- 172.21.15.88:0/1237457537 wait complete. 2024-09-13T18:05:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- 172.21.15.88:0/513245201 shutdown_connections 2024-09-13T18:05:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- 172.21.15.88:0/513245201 wait complete. 2024-09-13T18:05:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 Processor -- start 2024-09-13T18:05:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 Processor -- start 2024-09-13T18:05:38.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- start start 2024-09-13T18:05:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- start start 2024-09-13T18:05:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa41406cfb0 0x7fa4140c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4140721e0 0x7fa41414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41414f400 con 0x7fa414150070 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4141ef4c0 con 0x7fa41406cfb0 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa41b22e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41414f6a0 con 0x7fa4140721e0 2024-09-13T18:05:38.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b5c150ef0 0x7f0b5c1ec440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c14ce70 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c14d100 con 0x7f0b5c150ef0 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b60c5f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c14c0b0 con 0x7f0b5c0c47c0 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48974/0 (socket says 172.21.15.88:48974) 2024-09-13T18:05:38.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 -- 172.21.15.88:0/1907362939 learned_addr learned my addr 172.21.15.88:0/1907362939 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48976/0 (socket says 172.21.15.88:48976) 2024-09-13T18:05:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 -- 172.21.15.88:0/2415249225 learned_addr learned my addr 172.21.15.88:0/2415249225 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa418fca700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa41406cfb0 0x7fa4140c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5affd700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5bfff700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b5c150ef0 0x7f0b5c1ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa413fff700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4140721e0 0x7fa41414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 -- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4140721e0 msgr2=0x7fa41414cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4140721e0 0x7fa41414cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 -- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa41406cfb0 msgr2=0x7fa4140c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa41406cfb0 0x7fa4140c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.861 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 -- 172.21.15.88:0/1907362939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa404009570 con 0x7fa414150070 2024-09-13T18:05:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 -- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 msgr2=0x7f0b5c1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 -- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b5c150ef0 msgr2=0x7f0b5c1ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b5c150ef0 0x7f0b5c1ec440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.862 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7f0b5b7fe700 1 -- 172.21.15.88:0/2415249225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b440094b0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.812+0000 7fa4197cb700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa40c007ef0 tx=0x7fa40c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b5b7fe700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400ca70 tx=0x7f0b5400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c00de30 con 0x7fa414150070 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40c00f040 con 0x7fa414150070 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa41b22e700 1 -- 172.21.15.88:0/1907362939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41414f980 con 0x7fa414150070 2024-09-13T18:05:38.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40c003c80 con 0x7fa414150070 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa41b22e700 1 -- 172.21.15.88:0/1907362939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4141ef7a0 con 0x7fa414150070 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007480 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b540075e0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b54007970 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c14c390 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c14c950 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f55b4051950 con 0x7f55bc0c5090 2024-09-13T18:05:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c14cb70 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec005310 con 0x7fa414150070 2024-09-13T18:05:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4801c070 con 0x7f7c581ee030 2024-09-13T18:05:38.865 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4800fb70 con 0x7f7c581ee030 2024-09-13T18:05:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c480036c0 con 0x7f7c581ee030 2024-09-13T18:05:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740052d0 con 0x7f6170004870 2024-09-13T18:05:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174005430 con 0x7f6170004870 2024-09-13T18:05:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f61892c8700 1 -- 172.21.15.88:0/3972446724 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740055a0 con 0x7f6170004870 2024-09-13T18:05:38.866 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa40c004030 con 0x7fa414150070 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 0x7fa400068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa40c084230 con 0x7fa414150070 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b5401b3b0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 0x7f0b3c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b54083e10 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c581ee5f0 con 0x7f7c581ee030 2024-09-13T18:05:38.867 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c580c6950 con 0x7f7c581ee030 2024-09-13T18:05:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f618b2cc700 1 -- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 msgr2=0x7f6170004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 0x7f6170004cf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f61740018f0 tx=0x7f61700058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff658052970 con 0x7ff6640719b0 2024-09-13T18:05:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.816+0000 7f0b5affd700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 0x7f0b3c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f0b5affd700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 0x7f0b3c068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14dfb0 tx=0x7f0b4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7c48003820 con 0x7f7c581ee030 2024-09-13T18:05:38.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f7c46ffd700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 0x7f7c38068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c48084ec0 con 0x7f7c581ee030 2024-09-13T18:05:38.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f7c5659c700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 0x7f7c38068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.820+0000 7f7c5659c700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 0x7f7c38068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000f60 tx=0x7f7c4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 -- 172.21.15.88:0/3972446724 shutdown_connections 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3972446724 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6170004870 0x7f6170004cf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 -- 172.21.15.88:0/3972446724 >> 172.21.15.88:0/3972446724 conn(0x7f61840664b0 msgr2=0x7f618406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758004920 con 0x7fb76006c170 2024-09-13T18:05:38.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580092e0 con 0x7fb76006c170 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75801c680 con 0x7fb76006c170 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb76013dba0 con 0x7fb76006c170 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb760153f00 con 0x7fb76006c170 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 -- 172.21.15.88:0/3972446724 shutdown_connections 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 -- 172.21.15.88:0/3972446724 wait complete. 2024-09-13T18:05:38.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 Processor -- start 2024-09-13T18:05:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb75801c7e0 con 0x7fb76006c170 2024-09-13T18:05:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b540511d0 con 0x7f0b5c0c20d0 2024-09-13T18:05:38.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7f618b2cc700 1 -- start start 2024-09-13T18:05:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 0x7fb744068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb758085b00 con 0x7fb76006c170 2024-09-13T18:05:38.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fb765b87700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 0x7fb744068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170004870 0x7f6184158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6184145780 0x7f61840c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840c8770 con 0x7f6184145320 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61840c8490 con 0x7f6184145780 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618b2cc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6184145d60 con 0x7f6170004870 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48982/0 (socket says 172.21.15.88:48982) 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 -- 172.21.15.88:0/3700888206 learned_addr learned my addr 172.21.15.88:0/3700888206 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f618aacb700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6184145780 0x7f61840c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 -- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170004870 msgr2=0x7f6184158540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170004870 0x7f6184158540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 -- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6184145780 msgr2=0x7f61840c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6184145780 0x7f61840c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 -- 172.21.15.88:0/3700888206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6184146040 con 0x7f6184145320 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7fb765b87700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 0x7fb744068cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ca510 tx=0x7fb750008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.875 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.828+0000 7f6189ac9700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6174000c00 tx=0x7f6174001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fa418fca700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 0x7fa400068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.824+0000 7fa418fca700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 0x7fa400068c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa404008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.832+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c580c33c0 con 0x7f7c581ee030 2024-09-13T18:05:38.876 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.832+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7600c1240 con 0x7fb76006c170 2024-09-13T18:05:38.877 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.832+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa40c0515b0 con 0x7fa414150070 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61740055a0 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6174007240 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6184144b20 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61840c1240 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6174007610 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6174019070 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 0x7f6168068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6174084740 con 0x7f6184145320 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.836+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 0x7f6168068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:38.878 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.840+0000 7f618a2ca700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 0x7f6168068c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f617c007550 tx=0x7f617c0074c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.840+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c005310 con 0x7f6184145320 2024-09-13T18:05:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.840+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7c580c33c0 con 0x7f7c581ee030 2024-09-13T18:05:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.844+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb758052ee0 con 0x7fb76006c170 2024-09-13T18:05:38.879 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:38.848+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6174082e60 con 0x7f6184145320 2024-09-13T18:05:39.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.120+0000 7f09425e5700 1 -- 172.21.15.88:0/2196575171 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f091c0055c0 con 0x7f093c14f180 2024-09-13T18:05:39.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.124+0000 7f0938ff9700 1 -- 172.21.15.88:0/2196575171 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f092c006ab0 con 0x7f093c14f180 2024-09-13T18:05:39.129 INFO:teuthology.orchestra.run.smithi088.stdout:60129542149 2024-09-13T18:05:39.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 msgr2=0x7f0928068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 0x7f0928068bf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f09300061c0 tx=0x7f09300060d0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 msgr2=0x7f093c0c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f092c014000 tx=0x7f092c004770 comp rx=0 tx=0).stop 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 shutdown_connections 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0928066730 0x7f0928068bf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f093c0bb3f0 0x7f093c0b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c14f180 0x7f093c0c07a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 --2- 172.21.15.88:0/2196575171 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f093c06c580 0x7f093c0c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 >> 172.21.15.88:0/2196575171 conn(0x7f093c0664b0 msgr2=0x7f093c0c9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 shutdown_connections 2024-09-13T18:05:39.132 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.128+0000 7f09227fc700 1 -- 172.21.15.88:0/2196575171 wait complete. 2024-09-13T18:05:39.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.132+0000 7ff669508700 1 -- 172.21.15.88:0/931669856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff644005890 con 0x7ff6640719b0 2024-09-13T18:05:39.135 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.132+0000 7ff64b7fe700 1 -- 172.21.15.88:0/931669856 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff658055f90 con 0x7ff6640719b0 2024-09-13T18:05:39.138 INFO:teuthology.orchestra.run.smithi088.stdout:60129542149 2024-09-13T18:05:39.142 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f55bc0c61c0 con 0x7f55bc0c5090 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 msgr2=0x7ff650068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 0x7ff650068c20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff65c002080 tx=0x7ff65c001690 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 msgr2=0x7ff66414de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff658000c00 tx=0x7ff658004770 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 shutdown_connections 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff650066760 0x7ff650068c20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6640c5090 0x7ff66414c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6640719b0 0x7ff66414de70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 --2- 172.21.15.88:0/931669856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff66406c170 0x7ff6641f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 >> 172.21.15.88:0/931669856 conn(0x7ff6640664b0 msgr2=0x7ff664071e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 shutdown_connections 2024-09-13T18:05:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7ff6497fa700 1 -- 172.21.15.88:0/931669856 wait complete. 2024-09-13T18:05:39.145 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.140+0000 7f55b97fa700 1 -- 172.21.15.88:0/69630451 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f55b4018090 con 0x7f55bc0c5090 2024-09-13T18:05:39.145 INFO:teuthology.orchestra.run.smithi088.stdout:64424509446 2024-09-13T18:05:39.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.4 2024-09-13T18:05:39.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.144+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0b5c1512d0 con 0x7f0b5c0c20d0 2024-09-13T18:05:39.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.144+0000 7f0b53fff700 1 -- 172.21.15.88:0/2415249225 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0b54017030 con 0x7f0b5c0c20d0 2024-09-13T18:05:39.149 INFO:teuthology.orchestra.run.smithi088.stdout:60129542149 2024-09-13T18:05:39.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 msgr2=0x7f0b3c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 0x7f0b3c068c20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c14dfb0 tx=0x7f0b4c008040 comp rx=0 tx=0).stop 2024-09-13T18:05:39.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 msgr2=0x7f0b5c1520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0b5400ca70 tx=0x7f0b5400caa0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 shutdown_connections 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b3c066760 0x7f0b3c068c20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b5c0c47c0 0x7f0b5c1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b5c150ef0 0x7f0b5c1ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 --2- 172.21.15.88:0/2415249225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b5c0c20d0 0x7f0b5c1520a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 >> 172.21.15.88:0/2415249225 conn(0x7f0b5c0664b0 msgr2=0x7f0b5c0c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 shutdown_connections 2024-09-13T18:05:39.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.148+0000 7f0b60c5f700 1 -- 172.21.15.88:0/2415249225 wait complete. 2024-09-13T18:05:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.152+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7c580c33c0 con 0x7f7c581ee030 2024-09-13T18:05:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.152+0000 7f7c46ffd700 1 -- 172.21.15.88:0/3595040830 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c580c33c0 con 0x7f7c581ee030 2024-09-13T18:05:39.157 INFO:teuthology.orchestra.run.smithi088.stdout:60129542149 2024-09-13T18:05:39.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.6 2024-09-13T18:05:39.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa3ec005890 con 0x7fa414150070 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 msgr2=0x7f55a8068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 0x7f55a8068c40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f55ac014040 tx=0x7f55ac008030 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 msgr2=0x7f55bc1fb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f55b400cce0 tx=0x7f55b400a060 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 shutdown_connections 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f55a8066780 0x7f55a8068c40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f55bc0c5090 0x7f55bc1fb9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f55bc150010 0x7f55bc1fbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 --2- 172.21.15.88:0/69630451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f55bc06ca90 0x7f55bc0c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 >> 172.21.15.88:0/69630451 conn(0x7f55bc0664b0 msgr2=0x7f55bc156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 shutdown_connections 2024-09-13T18:05:39.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 msgr2=0x7f7c38068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 0x7f7c38068c20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000f60 tx=0x7f7c4c009040 comp rx=0 tx=0).stop 2024-09-13T18:05:39.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 msgr2=0x7f7c58152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806d590 tx=0x7f7c48004770 comp rx=0 tx=0).stop 2024-09-13T18:05:39.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7fa4117fa700 1 -- 172.21.15.88:0/1907362939 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa40c054bd0 con 0x7fa414150070 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 shutdown_connections 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7c38066760 0x7f7c38068c20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c581ee030 0x7f7c58152890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580c1570 0x7f7c581edaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 --2- 172.21.15.88:0/3595040830 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c5806bfd0 0x7f7c580c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 >> 172.21.15.88:0/3595040830 conn(0x7f7c580664b0 msgr2=0x7f7c58154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f55c30a2700 1 -- 172.21.15.88:0/69630451 wait complete. 2024-09-13T18:05:39.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 shutdown_connections 2024-09-13T18:05:39.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.156+0000 7f7c5759e700 1 -- 172.21.15.88:0/3595040830 wait complete. 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 msgr2=0x7fa400068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 0x7fa400068c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa404008030 comp rx=0 tx=0).stop 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 msgr2=0x7fa41414d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa40c007ef0 tx=0x7fa40c00d3b0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 shutdown_connections 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa400066760 0x7fa400068c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4140721e0 0x7fa41414cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa414150070 0x7fa41414d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 --2- 172.21.15.88:0/1907362939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa41406cfb0 0x7fa4140c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 >> 172.21.15.88:0/1907362939 conn(0x7fa4140ca790 msgr2=0x7fa414148c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 shutdown_connections 2024-09-13T18:05:39.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.160+0000 7fa3faffd700 1 -- 172.21.15.88:0/1907362939 wait complete. 2024-09-13T18:05:39.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.164+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f616c005890 con 0x7f6184145320 2024-09-13T18:05:39.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.164+0000 7f617affd700 1 -- 172.21.15.88:0/3700888206 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f617402a070 con 0x7f6184145320 2024-09-13T18:05:39.169 INFO:teuthology.orchestra.run.smithi088.stdout:55834574853 2024-09-13T18:05:39.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.3 2024-09-13T18:05:39.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.164+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb7601541e0 con 0x7fb76006c170 2024-09-13T18:05:39.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.164+0000 7fb756ffd700 1 -- 172.21.15.88:0/3541101703 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb758056500 con 0x7fb76006c170 2024-09-13T18:05:39.171 INFO:teuthology.orchestra.run.smithi088.stdout:64424509446 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 msgr2=0x7f6168068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 0x7f6168068c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f617c007550 tx=0x7f617c0074c0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 msgr2=0x7f61840c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6174000c00 tx=0x7f6174001230 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 shutdown_connections 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6168066780 0x7f6168068c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6184145780 0x7f61840c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6184145320 0x7f61840c9180 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 --2- 172.21.15.88:0/3700888206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6170004870 0x7f6184158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 >> 172.21.15.88:0/3700888206 conn(0x7f61840664b0 msgr2=0x7f618414df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 shutdown_connections 2024-09-13T18:05:39.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7f618b2cc700 1 -- 172.21.15.88:0/3700888206 wait complete. 2024-09-13T18:05:39.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 msgr2=0x7fb744068cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 0x7fb744068cf0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ca510 tx=0x7fb750008040 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 msgr2=0x7fb760158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb7580042f0 tx=0x7fb758004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 shutdown_connections 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb744066830 0x7fb744068cf0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7600719b0 0x7fb760152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb76006ca90 0x7fb76013e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 --2- 172.21.15.88:0/3541101703 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb76006c170 0x7fb760158460 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 >> 172.21.15.88:0/3541101703 conn(0x7fb7600664b0 msgr2=0x7fb760156710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 shutdown_connections 2024-09-13T18:05:39.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:39.168+0000 7fb7685ec700 1 -- 172.21.15.88:0/3541101703 wait complete. 2024-09-13T18:05:39.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.1 2024-09-13T18:05:39.176 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-13T18:05:39.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.0 2024-09-13T18:05:39.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2024-09-13T18:05:39.185 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2024-09-13T18:05:40.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:05:40.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:05:40.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:05:40.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:05:40.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:05:40.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:05:40.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:05:40.186 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:05:40.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 Processor -- start 2024-09-13T18:05:40.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 -- start start 2024-09-13T18:05:40.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342014f180 0x7f34201559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f342006c580 0x7f342006c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3420155f10 con 0x7f342006b680 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342006c0f0 con 0x7f342006c580 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f342778c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34200c1890 con 0x7f342014f180 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f3424d27700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f342006b680 0x7f34200c7120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54706/0 (socket says 172.21.15.88:54706) 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.280+0000 7f3424d27700 1 -- 172.21.15.88:0/2351130683 learned_addr learned my addr 172.21.15.88:0/2351130683 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 --2- 172.21.15.88:0/2351130683 >> v2:172.21.15.94:3300/0 conn(0x7f342006c580 0x7f342006c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3417fff700 1 -- 172.21.15.88:0/2351130683 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179448466 0 0) 0x7f3418001490 con 0x7f342006b680 2024-09-13T18:05:40.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425528700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342014f180 0x7f34201559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3417fff700 1 -- 172.21.15.88:0/2351130683 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340c0035d0 con 0x7f342006b680 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 -- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342014f180 msgr2=0x7f34201559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342014f180 0x7f34201559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 -- 172.21.15.88:0/2351130683 >> v1:172.21.15.88:6789/0 conn(0x7f342006b680 legacy=0x7f34200c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 -- 172.21.15.88:0/2351130683 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342006cf30 con 0x7f342006c580 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3425d29700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006c580 0x7f342006c9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f341c00a9f0 tx=0x7f341c00ad00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=785181e2fd087847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3417fff700 1 -- 172.21.15.88:0/2351130683 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c00cb70 con 0x7f342006c580 2024-09-13T18:05:40.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3417fff700 1 -- 172.21.15.88:0/2351130683 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c00ae90 con 0x7f342006c580 2024-09-13T18:05:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f3417fff700 1 -- 172.21.15.88:0/2351130683 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c018400 con 0x7f342006c580 2024-09-13T18:05:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 -- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006c580 msgr2=0x7f342006c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006c580 0x7f342006c9f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f341c00a9f0 tx=0x7f341c00ad00 comp rx=0 tx=0).stop 2024-09-13T18:05:40.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 -- 172.21.15.88:0/2351130683 shutdown_connections 2024-09-13T18:05:40.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006c580 0x7f342006c9f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 --2- 172.21.15.88:0/2351130683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342014f180 0x7f34201559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 -- 172.21.15.88:0/2351130683 >> 172.21.15.88:0/2351130683 conn(0x7f34200664b0 msgr2=0x7f342006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 -- 172.21.15.88:0/2351130683 shutdown_connections 2024-09-13T18:05:40.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.284+0000 7f342778c700 1 -- 172.21.15.88:0/2351130683 wait complete. 2024-09-13T18:05:40.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 Processor -- start 2024-09-13T18:05:40.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 -- start start 2024-09-13T18:05:40.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006b680 0x7f342014d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342006c580 0x7f34201506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 Processor -- start 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 -- start start 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9da00c6670 0x7f9da015dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da00c6a50 0x7f9da0157020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da015d810 con 0x7f9da0160840 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00c7c00 con 0x7f9da00c6a50 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9da588e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00c57a0 con 0x7f9da00c6670 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da00c6a50 0x7f9da0157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9da00c6a50 0x7f9da0157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48986/0 (socket says 172.21.15.88:48986) 2024-09-13T18:05:40.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/2165806038 learned_addr learned my addr 172.21.15.88:0/2165806038 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/2165806038 >> v2:172.21.15.94:3300/0 conn(0x7f9da00c6670 msgr2=0x7f9da015dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3424d27700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342006c580 0x7f34201506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48998/0 (socket says 172.21.15.88:48998) 2024-09-13T18:05:40.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 -- 172.21.15.88:0/1492050833 learned_addr learned my addr 172.21.15.88:0/1492050833 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 --2- 172.21.15.88:0/2165806038 >> v2:172.21.15.94:3300/0 conn(0x7f9da00c6670 0x7f9da015dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/2165806038 >> v1:172.21.15.94:6789/0 conn(0x7f9da0160840 legacy=0x7f9da00c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/2165806038 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da015e1e0 con 0x7f9da00c6a50 2024-09-13T18:05:40.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425528700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006b680 0x7f342014d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9f7fe700 1 --2- 172.21.15.88:0/2165806038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da00c6a50 0x7f9da0157020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9da0066a40 tx=0x7f9d9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12fe7831b54adfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34201eb210 con 0x7f342014f180 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34201510a0 con 0x7f342006b680 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34201ea590 con 0x7f342006c580 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9dffb700 1 -- 172.21.15.88:0/2165806038 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800e070 con 0x7f9da00c6a50 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9dffb700 1 -- 172.21.15.88:0/2165806038 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9800b980 con 0x7f9da00c6a50 2024-09-13T18:05:40.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f9d9dffb700 1 -- 172.21.15.88:0/2165806038 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800bd30 con 0x7f9da00c6a50 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 -- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342006c580 msgr2=0x7f34201506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342006c580 0x7f34201506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 -- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006b680 msgr2=0x7f342014d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006b680 0x7f342014d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c00a650 con 0x7f342014f180 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3425d29700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341c00a1c0 tx=0x7f341c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.288+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c003ad0 con 0x7f342014f180 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c003c30 con 0x7f342014f180 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c0045b0 con 0x7f342014f180 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34201ea870 con 0x7f342014f180 2024-09-13T18:05:40.297 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34201eae30 con 0x7f342014f180 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- 172.21.15.88:0/2165806038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da00c6a50 msgr2=0x7f9da0157020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 --2- 172.21.15.88:0/2165806038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da00c6a50 0x7f9da0157020 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9da0066a40 tx=0x7f9d9800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- 172.21.15.88:0/2165806038 shutdown_connections 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 --2- 172.21.15.88:0/2165806038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da00c6a50 0x7f9da0157020 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 --2- 172.21.15.88:0/2165806038 >> v2:172.21.15.94:3300/0 conn(0x7f9da00c6670 0x7f9da015dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- 172.21.15.88:0/2165806038 >> 172.21.15.88:0/2165806038 conn(0x7f9da00664b0 msgr2=0x7f9da006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- 172.21.15.88:0/2165806038 shutdown_connections 2024-09-13T18:05:40.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f341c018400 con 0x7f342014f180 2024-09-13T18:05:40.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f3415ffb700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 0x7f3404068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f341c085780 con 0x7f342014f180 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- 172.21.15.88:0/2165806038 wait complete. 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 Processor -- start 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.292+0000 7f9da588e700 1 -- start start 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9da00c6670 0x7f9da0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9da00c6a50 0x7f9da00c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00cb220 con 0x7f9da0160840 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0157fc0 con 0x7f9da00c6670 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01441a0 con 0x7f9da00c6a50 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49010/0 (socket says 172.21.15.88:49010) 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/1859079015 learned_addr learned my addr 172.21.15.88:0/1859079015 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9effd700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9da00c6670 0x7f9da0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9e7fc700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9da00c6a50 0x7f9da00c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9da00c6a50 msgr2=0x7f9da00c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9da00c6a50 0x7f9da00c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9da00c6670 msgr2=0x7f9da0150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9da00c6670 0x7f9da0150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 -- 172.21.15.88:0/1859079015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d98009b30 con 0x7f9da0160840 2024-09-13T18:05:40.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f3425528700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 0x7f3404068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d9f7fe700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d98012000 tx=0x7f9d98004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980048b0 con 0x7f9da0160840 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d980092e0 con 0x7f9da0160840 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 -- 172.21.15.88:0/1859079015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da0144480 con 0x7f9da0160840 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.296+0000 7f9da588e700 1 -- 172.21.15.88:0/1859079015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0157970 con 0x7f9da0160840 2024-09-13T18:05:40.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.300+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34201eb350 con 0x7f342014f180 2024-09-13T18:05:40.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9da588e700 1 -- 172.21.15.88:0/1859079015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0158170 con 0x7f9da0160840 2024-09-13T18:05:40.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9801c680 con 0x7f9da0160840 2024-09-13T18:05:40.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9d9801c860 con 0x7f9da0160840 2024-09-13T18:05:40.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f3425528700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 0x7f3404068cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f341000b9d0 tx=0x7f3410008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d87fff700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 0x7f9d8c068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d980853a0 con 0x7f9da0160840 2024-09-13T18:05:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d9effd700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 0x7f9d8c068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.304+0000 7f9d9effd700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 0x7f9d8c068c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d94006fd0 tx=0x7f9d94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.308+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f34201eb350 con 0x7f342014f180 2024-09-13T18:05:40.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.312+0000 7f7772c76700 1 Processor -- start 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.312+0000 7f7772c76700 1 -- start start 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7772c76700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f776c0c1590 0x7f776c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7772c76700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f776c0c6cb0 0x7f776c166360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7772c76700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c163810 con 0x7f776c0c11b0 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7772c76700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c165f40 con 0x7f776c0c6cb0 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7772c76700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c06be00 con 0x7f776c0c1590 2024-09-13T18:05:40.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9da0158170 con 0x7f9da0160840 2024-09-13T18:05:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7770a12700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f776c0c11b0 0x7f776c163100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54712/0 (socket says 172.21.15.88:54712) 2024-09-13T18:05:40.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7770a12700 1 -- 172.21.15.88:0/232964904 learned_addr learned my addr 172.21.15.88:0/232964904 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 --2- 172.21.15.88:0/232964904 >> v2:172.21.15.94:3300/0 conn(0x7f776c0c1590 0x7f776c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f7771213700 1 --2- 172.21.15.88:0/232964904 >> v2:172.21.15.88:3300/0 conn(0x7f776c0c6cb0 0x7f776c166360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 -- 172.21.15.88:0/232964904 >> v2:172.21.15.88:3300/0 conn(0x7f776c0c6cb0 msgr2=0x7f776c166360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 --2- 172.21.15.88:0/232964904 >> v2:172.21.15.88:3300/0 conn(0x7f776c0c6cb0 0x7f776c166360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 -- 172.21.15.88:0/232964904 >> v1:172.21.15.88:6789/0 conn(0x7f776c0c11b0 legacy=0x7f776c163100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 -- 172.21.15.88:0/232964904 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0c7510 con 0x7f776c0c1590 2024-09-13T18:05:40.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.316+0000 7f776bfff700 1 --2- 172.21.15.88:0/232964904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c1590 0x7f776c0c6770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f776c0c8000 tx=0x7f775c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9503ca5d03a87a47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f776b7fe700 1 -- 172.21.15.88:0/232964904 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c011830 con 0x7f776c0c1590 2024-09-13T18:05:40.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f776b7fe700 1 -- 172.21.15.88:0/232964904 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c011990 con 0x7f776c0c1590 2024-09-13T18:05:40.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f776b7fe700 1 -- 172.21.15.88:0/232964904 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c011d20 con 0x7f776c0c1590 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 -- 172.21.15.88:0/232964904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c1590 msgr2=0x7f776c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 --2- 172.21.15.88:0/232964904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c1590 0x7f776c0c6770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f776c0c8000 tx=0x7f775c009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 -- 172.21.15.88:0/232964904 shutdown_connections 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 --2- 172.21.15.88:0/232964904 >> v2:172.21.15.88:3300/0 conn(0x7f776c0c6cb0 0x7f776c166360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 --2- 172.21.15.88:0/232964904 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c1590 0x7f776c0c6770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 -- 172.21.15.88:0/232964904 >> 172.21.15.88:0/232964904 conn(0x7f776c0664b0 msgr2=0x7f776c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 -- 172.21.15.88:0/232964904 shutdown_connections 2024-09-13T18:05:40.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.320+0000 7f7772c76700 1 -- 172.21.15.88:0/232964904 wait complete. 2024-09-13T18:05:40.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 Processor -- start 2024-09-13T18:05:40.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 -- start start 2024-09-13T18:05:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c6cb0 0x7f776c0c0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f776c159c20 0x7f776c08a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c207100 con 0x7f776c0c11b0 2024-09-13T18:05:40.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c207330 con 0x7f776c0c6cb0 2024-09-13T18:05:40.329 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.324+0000 7f7772c76700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c203b90 con 0x7f776c159c20 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49042/0 (socket says 172.21.15.88:49042) 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 -- 172.21.15.88:0/3846147008 learned_addr learned my addr 172.21.15.88:0/3846147008 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7771213700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f776c159c20 0x7f776c08a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f776bfff700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c6cb0 0x7f776c0c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 -- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f776c159c20 msgr2=0x7f776c08a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f776c159c20 0x7f776c08a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 -- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c6cb0 msgr2=0x7f776c0c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c6cb0 0x7f776c0c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 -- 172.21.15.88:0/3846147008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0094b0 con 0x7f776c0c11b0 2024-09-13T18:05:40.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7770a12700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f776400cbc0 tx=0x7f776400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764007480 con 0x7f776c0c11b0 2024-09-13T18:05:40.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c2075f0 con 0x7f776c0c11b0 2024-09-13T18:05:40.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c207bb0 con 0x7f776c0c11b0 2024-09-13T18:05:40.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640075e0 con 0x7f776c0c11b0 2024-09-13T18:05:40.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7764007950 con 0x7f776c0c11b0 2024-09-13T18:05:40.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.332+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f776401c440 con 0x7f776c0c11b0 2024-09-13T18:05:40.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.336+0000 7f77697fa700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 0x7f7758068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.336+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7764083a10 con 0x7f776c0c11b0 2024-09-13T18:05:40.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.336+0000 7f776bfff700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 0x7f7758068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.336+0000 7f776bfff700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 0x7f7758068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.340+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774c005310 con 0x7f776c0c11b0 2024-09-13T18:05:40.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 Processor -- start 2024-09-13T18:05:40.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 -- start start 2024-09-13T18:05:40.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 0x7f649815aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980c69e0 con 0x7f6498150ef0 2024-09-13T18:05:40.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7764017080 con 0x7f776c0c11b0 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980c4bc0 con 0x7f64980c47c0 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6497fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649815af80 con 0x7f649815a5b0 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6496ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6498150ef0 0x7f649806d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54720/0 (socket says 172.21.15.88:54720) 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6496ffd700 1 -- 172.21.15.88:0/116879853 learned_addr learned my addr 172.21.15.88:0/116879853 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f64977fe700 1 --2- 172.21.15.88:0/116879853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 0x7f649815aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232331280 0 0) 0x7f64980c69e0 con 0x7f6498150ef0 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64800035d0 con 0x7f6498150ef0 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003023251 0 0) 0x7f64980c4bc0 con 0x7f64980c47c0 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64980c69e0 con 0x7f64980c47c0 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f64977fe700 1 -- 172.21.15.88:0/116879853 >> v1:172.21.15.94:6789/0 conn(0x7f64980c47c0 legacy=0x7f64980c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f64977fe700 1 -- 172.21.15.88:0/116879853 >> v1:172.21.15.88:6789/0 conn(0x7f6498150ef0 legacy=0x7f649806d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f64977fe700 1 -- 172.21.15.88:0/116879853 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980c5af0 con 0x7f649815a5b0 2024-09-13T18:05:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.348+0000 7f64977fe700 1 --2- 172.21.15.88:0/116879853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 0x7f649815aa40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6490009dc0 tx=0x7f649000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb9cf9c88f349b17 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000e070 con 0x7f649815a5b0 2024-09-13T18:05:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649000bb20 con 0x7f649815a5b0 2024-09-13T18:05:40.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6495ffb700 1 -- 172.21.15.88:0/116879853 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000be90 con 0x7f649815a5b0 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- 172.21.15.88:0/116879853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 msgr2=0x7f649815aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 --2- 172.21.15.88:0/116879853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 0x7f649815aa40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6490009dc0 tx=0x7f649000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- 172.21.15.88:0/116879853 shutdown_connections 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 --2- 172.21.15.88:0/116879853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f649815a5b0 0x7f649815aa40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- 172.21.15.88:0/116879853 >> 172.21.15.88:0/116879853 conn(0x7f64980664b0 msgr2=0x7f649806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- 172.21.15.88:0/116879853 shutdown_connections 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- 172.21.15.88:0/116879853 wait complete. 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 Processor -- start 2024-09-13T18:05:40.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.352+0000 7f6497fff700 1 -- start start 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64980c47c0 0x7f64981ef570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f649815a5b0 0x7f6498154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6498152480 con 0x7f649815a5b0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c1620 con 0x7f64980c47c0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c3170 con 0x7f6498150ef0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6496ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64980c47c0 0x7f64981ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:40168/0 (socket says 172.21.15.88:40168) 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 -- 172.21.15.88:0/2638329267 learned_addr learned my addr 172.21.15.88:0/2638329267 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64977fe700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f649815a5b0 0x7f6498154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 -- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64980c47c0 msgr2=0x7f64981ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64980c47c0 0x7f64981ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 -- 172.21.15.88:0/2638329267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f649815a5b0 msgr2=0x7f6498154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f649815a5b0 0x7f6498154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 -- 172.21.15.88:0/2638329267 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009a70 con 0x7f6498150ef0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f64967fc700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c500 tx=0x7f648c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0052d0 con 0x7f6498150ef0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c005450 con 0x7f6498150ef0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64981521a0 con 0x7f6498150ef0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64981f0110 con 0x7f6498150ef0 2024-09-13T18:05:40.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 Processor -- start 2024-09-13T18:05:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 -- start start 2024-09-13T18:05:40.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c0038e0 con 0x7f6498150ef0 2024-09-13T18:05:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 0x7fdfd815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 0x7fdfd8157020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd815d810 con 0x7fdfd8160840 2024-09-13T18:05:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd80c7c00 con 0x7fdfd80c6a50 2024-09-13T18:05:40.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdec36700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c57a0 con 0x7fdfd80c6670 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.356+0000 7fdfdd433700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdfd8160840 0x7fdfd80c5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54734/0 (socket says 172.21.15.88:54734) 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfdd433700 1 -- 172.21.15.88:0/2390644681 learned_addr learned my addr 172.21.15.88:0/2390644681 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 --2- 172.21.15.88:0/2390644681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 0x7fdfd815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfde435700 1 --2- 172.21.15.88:0/2390644681 >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 0x7fdfd8157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 -- 172.21.15.88:0/2390644681 >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 msgr2=0x7fdfd8157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 --2- 172.21.15.88:0/2390644681 >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 0x7fdfd8157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 -- 172.21.15.88:0/2390644681 >> v1:172.21.15.88:6789/0 conn(0x7fdfd8160840 legacy=0x7fdfd80c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 -- 172.21.15.88:0/2390644681 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd815e1e0 con 0x7fdfd80c6670 2024-09-13T18:05:40.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfde435700 1 --2- 172.21.15.88:0/2390644681 >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 0x7fdfd8157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:40.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64981512d0 con 0x7f6498150ef0 2024-09-13T18:05:40.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f648c003a40 con 0x7f6498150ef0 2024-09-13T18:05:40.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fdfddc34700 1 --2- 172.21.15.88:0/2390644681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 0x7fdfd815dca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009850 tx=0x7fdfc8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a574383e4c62b2d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f647ffff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 0x7f6484068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f648c0835c0 con 0x7f6498150ef0 2024-09-13T18:05:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f6496ffd700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 0x7f6484068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f6496ffd700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 0x7f6484068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6488007fd0 tx=0x7f6488007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fd58e6fa700 1 Processor -- start 2024-09-13T18:05:40.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f16c51fe700 1 Processor -- start 2024-09-13T18:05:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7fd58e6fa700 1 -- start start 2024-09-13T18:05:40.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.360+0000 7f16c51fe700 1 -- start start 2024-09-13T18:05:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 Processor -- start 2024-09-13T18:05:40.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 -- start start 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd588158f90 0x7fd58806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd588152dc0 0x7fd588153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd588153770 con 0x7fd58806c300 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd588072530 con 0x7fd588158f90 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd588071c90 con 0x7fd588152dc0 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd588158f90 0x7fd58806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f16c0071470 0x7f16c006c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd588158f90 0x7fd58806c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49074/0 (socket says 172.21.15.88:49074) 2024-09-13T18:05:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 -- 172.21.15.88:0/4144822958 learned_addr learned my addr 172.21.15.88:0/4144822958 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c0071c90 con 0x7f16c0152dc0 2024-09-13T18:05:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c0072530 con 0x7f16c0071470 2024-09-13T18:05:40.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0071f70 con 0x7f16c006c300 2024-09-13T18:05:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 -- 172.21.15.88:0/4144822958 >> v2:172.21.15.94:3300/0 conn(0x7fd588152dc0 msgr2=0x7fd588153230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:05:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f16c0071470 0x7f16c006c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bed9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f16c0071470 0x7f16c006c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:46026/0 (socket says 172.21.15.88:46026) 2024-09-13T18:05:40.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bed9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:40200/0 (socket says 172.21.15.88:40200) 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 -- 172.21.15.88:0/639154838 learned_addr learned my addr 172.21.15.88:0/639154838 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bf59e700 1 --1- 172.21.15.88:0/639154838 >> v1:172.21.15.94:6789/0 conn(0x7f16c0152dc0 0x7f16c015ada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:50884/0 (socket says 172.21.15.88:50884) 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 --2- 172.21.15.88:0/4144822958 >> v2:172.21.15.94:3300/0 conn(0x7fd588152dc0 0x7fd588153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 -- 172.21.15.88:0/4144822958 >> v1:172.21.15.94:6789/0 conn(0x7fd58806c300 legacy=0x7fd588071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 -- 172.21.15.88:0/4144822958 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588071f70 con 0x7fd588158f90 2024-09-13T18:05:40.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbb1806ddc0 0x7fbb18156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 0x7fbb180c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180c1d30 con 0x7fbb1806f580 2024-09-13T18:05:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb180c2a30 con 0x7fbb1806ddc0 2024-09-13T18:05:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1ebfe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c3be0 con 0x7fbb1806e1a0 2024-09-13T18:05:40.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58cef7700 1 --2- 172.21.15.88:0/4144822958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd588158f90 0x7fd58806c6e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd580009e50 tx=0x7fd58000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348dcfc3424fd238 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 -- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 msgr2=0x7f16c0158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 -- 172.21.15.88:0/639154838 >> v1:172.21.15.94:6789/0 conn(0x7f16c0152dc0 legacy=0x7f16c015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 -- 172.21.15.88:0/639154838 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0072250 con 0x7f16c0071470 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bed9d700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1d19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb1806f580 0x7fbb181508a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54738/0 (socket says 172.21.15.88:54738) 2024-09-13T18:05:40.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1d19b700 1 -- 172.21.15.88:0/4171291413 learned_addr learned my addr 172.21.15.88:0/4171291413 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 --2- 172.21.15.88:0/4171291413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 0x7fbb180c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb1c99a700 1 --2- 172.21.15.88:0/4171291413 >> v2:172.21.15.94:3300/0 conn(0x7fbb1806ddc0 0x7fbb18156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16be59c700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c0071470 0x7f16c006c6e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009e50 tx=0x7f16b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d626130ee2c59b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd57ffff700 1 -- 172.21.15.88:0/4144822958 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000e070 con 0x7fd588158f90 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd57ffff700 1 -- 172.21.15.88:0/4144822958 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58000b980 con 0x7fd588158f90 2024-09-13T18:05:40.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd57ffff700 1 -- 172.21.15.88:0/4144822958 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58000bd30 con 0x7fd588158f90 2024-09-13T18:05:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bdd9b700 1 -- 172.21.15.88:0/639154838 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800e070 con 0x7f16c0071470 2024-09-13T18:05:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bdd9b700 1 -- 172.21.15.88:0/639154838 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800b910 con 0x7f16c0071470 2024-09-13T18:05:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16bdd9b700 1 -- 172.21.15.88:0/639154838 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800bcc0 con 0x7f16c0071470 2024-09-13T18:05:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- 172.21.15.88:0/4144822958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd588158f90 msgr2=0x7fd58806c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.380 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/4144822958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd588158f90 0x7fd58806c6e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd580009e50 tx=0x7fd58000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 -- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c0071470 msgr2=0x7f16c006c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7f16c51fe700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c0071470 0x7f16c006c6e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009e50 tx=0x7f16b800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb177fe700 1 -- 172.21.15.88:0/4171291413 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178588521 0 0) 0x7fbb180c1d30 con 0x7fbb1806f580 2024-09-13T18:05:40.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- 172.21.15.88:0/4144822958 shutdown_connections 2024-09-13T18:05:40.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/4144822958 >> v2:172.21.15.94:3300/0 conn(0x7fd588152dc0 0x7fd588153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb177fe700 1 -- 172.21.15.88:0/4171291413 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb000035d0 con 0x7fbb1806f580 2024-09-13T18:05:40.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/4144822958 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd588158f90 0x7fd58806c6e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- 172.21.15.88:0/4144822958 >> 172.21.15.88:0/4144822958 conn(0x7fd5880664b0 msgr2=0x7fd58806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 -- 172.21.15.88:0/4171291413 >> v2:172.21.15.94:3300/0 conn(0x7fbb1806ddc0 msgr2=0x7fbb18156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 --2- 172.21.15.88:0/4171291413 >> v2:172.21.15.94:3300/0 conn(0x7fbb1806ddc0 0x7fbb18156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 -- 172.21.15.88:0/4171291413 >> v1:172.21.15.88:6789/0 conn(0x7fbb1806f580 legacy=0x7fbb181508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 -- 172.21.15.88:0/4171291413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180c4360 con 0x7fbb1806e1a0 2024-09-13T18:05:40.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fbb17fff700 1 --2- 172.21.15.88:0/4171291413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 0x7fbb180c24f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009850 tx=0x7fbb0c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=803b4a97e851655e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- 172.21.15.88:0/4144822958 shutdown_connections 2024-09-13T18:05:40.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.364+0000 7fd58e6fa700 1 -- 172.21.15.88:0/4144822958 wait complete. 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- 172.21.15.88:0/639154838 shutdown_connections 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c0071470 0x7f16c006c6e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 --2- 172.21.15.88:0/639154838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c006c300 0x7f16c0158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- 172.21.15.88:0/639154838 >> 172.21.15.88:0/639154838 conn(0x7f16c00664b0 msgr2=0x7f16c006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- 172.21.15.88:0/639154838 shutdown_connections 2024-09-13T18:05:40.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- 172.21.15.88:0/639154838 wait complete. 2024-09-13T18:05:40.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 Processor -- start 2024-09-13T18:05:40.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 Processor -- start 2024-09-13T18:05:40.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 -- start start 2024-09-13T18:05:40.387 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- start start 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c006c300 0x7f16c014f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 0x7f16c01546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01f2bb0 con 0x7f16c0071470 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c014c170 con 0x7f16c006c300 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16c51fe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c014e830 con 0x7f16c0152dc0 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49076/0 (socket says 172.21.15.88:49076) 2024-09-13T18:05:40.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 -- 172.21.15.88:0/1692847673 learned_addr learned my addr 172.21.15.88:0/1692847673 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdcc32700 1 -- 172.21.15.88:0/2390644681 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011830 con 0x7fdfd80c6670 2024-09-13T18:05:40.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdcc32700 1 -- 172.21.15.88:0/2390644681 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc8011990 con 0x7fdfd80c6670 2024-09-13T18:05:40.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdcc32700 1 -- 172.21.15.88:0/2390644681 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc8011d20 con 0x7fdfd80c6670 2024-09-13T18:05:40.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16bed9d700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c006c300 0x7f16c014f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 -- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 msgr2=0x7f16c01546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16bf59e700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 0x7f16c01546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 0x7f16c01546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 -- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c006c300 msgr2=0x7f16c014f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c006c300 0x7f16c014f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 -- 172.21.15.88:0/1692847673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40094b0 con 0x7f16c0071470 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16bf59e700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 0x7f16c01546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:40.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f16be59c700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16b800b370 tx=0x7f16b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 -- 172.21.15.88:0/2390644681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 msgr2=0x7fdfd815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 --2- 172.21.15.88:0/2390644681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 0x7fdfd815dca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009850 tx=0x7fdfc8009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 -- 172.21.15.88:0/2390644681 shutdown_connections 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 --2- 172.21.15.88:0/2390644681 >> v2:172.21.15.94:3300/0 conn(0x7fdfd80c6a50 0x7fdfd8157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 --2- 172.21.15.88:0/2390644681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd80c6670 0x7fdfd815dca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fdfdec36700 1 -- 172.21.15.88:0/2390644681 >> 172.21.15.88:0/2390644681 conn(0x7fdfd80664b0 msgr2=0x7fdfd806eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fbb177fe700 1 -- 172.21.15.88:0/4171291413 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011830 con 0x7fbb1806e1a0 2024-09-13T18:05:40.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fbb177fe700 1 -- 172.21.15.88:0/4171291413 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c011990 con 0x7fbb1806e1a0 2024-09-13T18:05:40.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fbb177fe700 1 -- 172.21.15.88:0/4171291413 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011d40 con 0x7fbb1806e1a0 2024-09-13T18:05:40.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/4171291413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 msgr2=0x7fbb180c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/4171291413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 0x7fbb180c24f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009850 tx=0x7fbb0c009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd588152dc0 0x7fd5881e4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd588158f90 0x7fd5881e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58814d6b0 con 0x7fd58806c300 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588156f70 con 0x7fd588152dc0 2024-09-13T18:05:40.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58e6fa700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58814a260 con 0x7fd588158f90 2024-09-13T18:05:40.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f648c050810 con 0x7f6498150ef0 2024-09-13T18:05:40.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58d6f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.368+0000 7fd58d6f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49090/0 (socket says 172.21.15.88:49090) 2024-09-13T18:05:40.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 -- 172.21.15.88:0/760519978 learned_addr learned my addr 172.21.15.88:0/760519978 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58cef7700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd588152dc0 0x7fd5881e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58def9700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd588158f90 0x7fd5881e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/4171291413 shutdown_connections 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/4171291413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806e1a0 0x7fbb180c24f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/4171291413 >> v2:172.21.15.94:3300/0 conn(0x7fbb1806ddc0 0x7fbb18156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/4171291413 >> 172.21.15.88:0/4171291413 conn(0x7fbb180ca790 msgr2=0x7fbb180caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 -- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd588158f90 msgr2=0x7fd5881e4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd588158f90 0x7fd5881e4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 -- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd588152dc0 msgr2=0x7fd5881e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd588152dc0 0x7fd5881e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 -- 172.21.15.88:0/760519978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd580009b30 con 0x7fd58806c300 2024-09-13T18:05:40.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/4171291413 shutdown_connections 2024-09-13T18:05:40.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- 172.21.15.88:0/2390644681 shutdown_connections 2024-09-13T18:05:40.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- 172.21.15.88:0/2390644681 wait complete. 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/4171291413 wait complete. 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 Processor -- start 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- start start 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806ddc0 0x7fbb181f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb1806e1a0 0x7fbb180c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb181f6d10 con 0x7fbb1806f580 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c6ad0 con 0x7fbb1806e1a0 2024-09-13T18:05:40.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1ebfe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180c7120 con 0x7fbb1806ddc0 2024-09-13T18:05:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 Processor -- start 2024-09-13T18:05:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- start start 2024-09-13T18:05:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd58d6f8700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c500 tx=0x7fd57800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49096/0 (socket says 172.21.15.88:49096) 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 -- 172.21.15.88:0/2755169794 learned_addr learned my addr 172.21.15.88:0/2755169794 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb17fff700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb1806e1a0 0x7fbb180c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 0x7fdfd81f67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 0x7fdfd815e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c8c40 con 0x7fdfd80c6a50 2024-09-13T18:05:40.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80c8630 con 0x7fdfd80c6670 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdec36700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd806c280 con 0x7fdfd8160840 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 -- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806ddc0 msgr2=0x7fbb181f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806ddc0 0x7fbb181f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 -- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb1806e1a0 msgr2=0x7fbb180c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb1806e1a0 0x7fbb180c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 -- 172.21.15.88:0/2755169794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0094b0 con 0x7fbb1806f580 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdd433700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdd433700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:49106/0 (socket says 172.21.15.88:49106) 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfdd433700 1 -- 172.21.15.88:0/229281677 learned_addr learned my addr 172.21.15.88:0/229281677 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfddc34700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 0x7fdfd81f67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fdfde435700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 0x7fdfd815e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780052d0 con 0x7fd58806c300 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.372+0000 7fbb1d19b700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800c4d0 tx=0x7fbb0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58814e930 con 0x7fd58806c300 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58814a470 con 0x7fd58806c300 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 -- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 msgr2=0x7fdfd81f67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 0x7fdfd81f67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 -- 172.21.15.88:0/229281677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 msgr2=0x7fdfd81e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 -- 172.21.15.88:0/229281677 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc80094b0 con 0x7fdfd8160840 2024-09-13T18:05:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfddc34700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 0x7fdfd81f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:40.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfdd433700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:40.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578005430 con 0x7fd58806c300 2024-09-13T18:05:40.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780055a0 con 0x7fd58806c300 2024-09-13T18:05:40.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfde435700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 0x7fdfd815e410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80c6e60 tx=0x7fdfd400e8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd400c070 con 0x7fdfd8160840 2024-09-13T18:05:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd4013610 con 0x7fdfd8160840 2024-09-13T18:05:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd806c560 con 0x7fdfd8160840 2024-09-13T18:05:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd806c840 con 0x7fdfd8160840 2024-09-13T18:05:40.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40139c0 con 0x7fdfd8160840 2024-09-13T18:05:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08005d90 con 0x7fbb1806f580 2024-09-13T18:05:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080070d0 con 0x7fbb1806f580 2024-09-13T18:05:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08007460 con 0x7fbb1806f580 2024-09-13T18:05:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1806d980 con 0x7fbb1806f580 2024-09-13T18:05:40.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb181f6a30 con 0x7fbb1806f580 2024-09-13T18:05:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfbc005310 con 0x7fdfd8160840 2024-09-13T18:05:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdfd4013b20 con 0x7fdfd8160840 2024-09-13T18:05:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 0x7fdfc4068d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfd4083e60 con 0x7fdfd8160840 2024-09-13T18:05:40.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fdfddc34700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 0x7fdfc4068d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.376+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd5780038e0 con 0x7fd58806c300 2024-09-13T18:05:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb080075c0 con 0x7fbb1806f580 2024-09-13T18:05:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fdfddc34700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 0x7fdfc4068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fd57dffb700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 0x7fd56c068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5780834c0 con 0x7fd58806c300 2024-09-13T18:05:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fbb157fa700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb08083560 con 0x7fbb1806f580 2024-09-13T18:05:40.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fd58cef7700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 0x7fd56c068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fbb1c99a700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fd58cef7700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 0x7fd56c068cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd580000f80 tx=0x7fd580009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.380+0000 7fbb1c99a700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 0x7fbb04068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e190 tx=0x7fbb1000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1814ff60 con 0x7fbb1806f580 2024-09-13T18:05:40.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80099b0 con 0x7f16c0071470 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b80092e0 con 0x7f16c0071470 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b801c640 con 0x7f16c0071470 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b8009b30 con 0x7f16c0071470 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c006cda0 con 0x7f16c0071470 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd568005310 con 0x7fd58806c300 2024-09-13T18:05:40.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.384+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdfd4051140 con 0x7fdfd8160840 2024-09-13T18:05:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.388+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0071870 con 0x7f16c0071470 2024-09-13T18:05:40.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.388+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb08050960 con 0x7fbb1806f580 2024-09-13T18:05:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.388+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f16b801c7a0 con 0x7f16c0071470 2024-09-13T18:05:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.388+0000 7f16af7fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 0x7f16a4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.392+0000 7f16bed9d700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 0x7f16a4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.392+0000 7f16bed9d700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 0x7f16a4068c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009d10 tx=0x7f16b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.392+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b8057680 con 0x7f16c0071470 2024-09-13T18:05:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.392+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd578050810 con 0x7fd58806c300 2024-09-13T18:05:40.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.400+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f16b80532c0 con 0x7f16c0071470 2024-09-13T18:05:40.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.616+0000 7f9da588e700 1 -- 172.21.15.88:0/1859079015 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9da0158130 con 0x7f9da0160840 2024-09-13T18:05:40.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.616+0000 7f9d87fff700 1 -- 172.21.15.88:0/1859079015 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d98052660 con 0x7f9da0160840 2024-09-13T18:05:40.623 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:40.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 msgr2=0x7f9d8c068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 0x7f9d8c068c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9d94006fd0 tx=0x7f9d94008040 comp rx=0 tx=0).stop 2024-09-13T18:05:40.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 msgr2=0x7f9da00c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d98012000 tx=0x7f9d98004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 shutdown_connections 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9d8c0667b0 0x7f9d8c068c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9da00c6a50 0x7f9da00c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9da0160840 0x7f9da00c4790 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 --2- 172.21.15.88:0/1859079015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9da00c6670 0x7f9da0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 >> 172.21.15.88:0/1859079015 conn(0x7f9da00664b0 msgr2=0x7f9da0160c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 shutdown_connections 2024-09-13T18:05:40.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.624+0000 7f9d85ffb700 1 -- 172.21.15.88:0/1859079015 wait complete. 2024-09-13T18:05:40.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.632+0000 7f342778c700 1 -- 172.21.15.88:0/1492050833 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f34201eb350 con 0x7f342014f180 2024-09-13T18:05:40.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.632+0000 7f3415ffb700 1 -- 172.21.15.88:0/1492050833 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f34201eb350 con 0x7f342014f180 2024-09-13T18:05:40.641 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 msgr2=0x7f3404068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 0x7f3404068cc0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f341000b9d0 tx=0x7f3410008040 comp rx=0 tx=0).stop 2024-09-13T18:05:40.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 msgr2=0x7f3420146f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f341c00a1c0 tx=0x7f341c004770 comp rx=0 tx=0).stop 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 shutdown_connections 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3404066800 0x7f3404068cc0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f342006c580 0x7f34201506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f342014f180 0x7f3420146f90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 --2- 172.21.15.88:0/1492050833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f342006b680 0x7f342014d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 >> 172.21.15.88:0/1492050833 conn(0x7f34200664b0 msgr2=0x7f34200c8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 shutdown_connections 2024-09-13T18:05:40.643 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.636+0000 7f34037fe700 1 -- 172.21.15.88:0/1492050833 wait complete. 2024-09-13T18:05:40.645 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-13T18:05:40.645 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-13T18:05:40.656 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.660+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f774c005180 con 0x7f776c0c11b0 2024-09-13T18:05:40.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.660+0000 7f77697fa700 1 -- 172.21.15.88:0/3846147008 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77640547b0 con 0x7f776c0c11b0 2024-09-13T18:05:40.664 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 msgr2=0x7f7758068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 0x7f7758068bf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f775c000c00 tx=0x7f775c008030 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 msgr2=0x7f776c173240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f776400cbc0 tx=0x7f776400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 shutdown_connections 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7758066730 0x7f7758068bf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f776c159c20 0x7f776c08a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f776c0c6cb0 0x7f776c0c0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 --2- 172.21.15.88:0/3846147008 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f776c0c11b0 0x7f776c173240 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 >> 172.21.15.88:0/3846147008 conn(0x7f776c0664b0 msgr2=0x7f776c0c8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 shutdown_connections 2024-09-13T18:05:40.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.664+0000 7f7772c76700 1 -- 172.21.15.88:0/3846147008 wait complete. 2024-09-13T18:05:40.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-13T18:05:40.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.676+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6498067d50 con 0x7f6498150ef0 2024-09-13T18:05:40.681 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.676+0000 7f647ffff700 1 -- 172.21.15.88:0/2638329267 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f648c053e30 con 0x7f6498150ef0 2024-09-13T18:05:40.681 INFO:teuthology.orchestra.run.smithi088.stdout:60129542150 2024-09-13T18:05:40.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdfbc005890 con 0x7fdfd8160840 2024-09-13T18:05:40.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfce7fc700 1 -- 172.21.15.88:0/229281677 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdfd4017090 con 0x7fdfd8160840 2024-09-13T18:05:40.683 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 msgr2=0x7f6484068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 0x7f6484068bf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6488007fd0 tx=0x7f6488007de0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 msgr2=0x7f64981548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f648c00c500 tx=0x7f648c00c810 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 shutdown_connections 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6484066730 0x7f6484068bf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6498150ef0 0x7f64981548d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f649815a5b0 0x7f6498154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 --2- 172.21.15.88:0/2638329267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f64980c47c0 0x7f64981ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 >> 172.21.15.88:0/2638329267 conn(0x7f64980664b0 msgr2=0x7f649814f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 shutdown_connections 2024-09-13T18:05:40.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7f6497fff700 1 -- 172.21.15.88:0/2638329267 wait complete. 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 msgr2=0x7fdfc4068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 0x7fdfc4068d30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdfc8009fd0 tx=0x7fdfc8008030 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 msgr2=0x7fdfd815e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 0x7fdfd815e410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80c6e60 tx=0x7fdfd400e8b0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 shutdown_connections 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdfc4066870 0x7fdfc4068d30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdfd8160840 0x7fdfd815e410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdfd80c6a50 0x7fdfd81e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 --2- 172.21.15.88:0/229281677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdfd80c6670 0x7fdfd81f67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 >> 172.21.15.88:0/229281677 conn(0x7fdfd80664b0 msgr2=0x7fdfd806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 shutdown_connections 2024-09-13T18:05:40.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.680+0000 7fdfdec36700 1 -- 172.21.15.88:0/229281677 wait complete. 2024-09-13T18:05:40.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.692+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbb180c4000 con 0x7fbb1806f580 2024-09-13T18:05:40.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.692+0000 7fbb157fa700 1 -- 172.21.15.88:0/2755169794 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb08053f80 con 0x7fbb1806f580 2024-09-13T18:05:40.697 INFO:teuthology.orchestra.run.smithi088.stdout:64424509447 2024-09-13T18:05:40.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-13T18:05:40.699 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-13T18:05:40.700 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 msgr2=0x7fbb04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 0x7fbb04068bf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000e190 tx=0x7fbb1000b040 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 msgr2=0x7fbb180c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800c4d0 tx=0x7fbb0800c890 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 shutdown_connections 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb04066730 0x7fbb04068bf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb1806f580 0x7fbb180c75b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb1806e1a0 0x7fbb180c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 --2- 172.21.15.88:0/2755169794 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb1806ddc0 0x7fbb181f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 >> 172.21.15.88:0/2755169794 conn(0x7fbb180ca790 msgr2=0x7fbb1814eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 shutdown_connections 2024-09-13T18:05:40.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.696+0000 7fbb1ebfe700 1 -- 172.21.15.88:0/2755169794 wait complete. 2024-09-13T18:05:40.709 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-13T18:05:40.709 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.716+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd5680055c0 con 0x7fd58806c300 2024-09-13T18:05:40.720 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.716+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f16c006f220 con 0x7f16c0071470 2024-09-13T18:05:40.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.716+0000 7fd57dffb700 1 -- 172.21.15.88:0/760519978 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd578017090 con 0x7fd58806c300 2024-09-13T18:05:40.721 INFO:teuthology.orchestra.run.smithi088.stdout:64424509447 2024-09-13T18:05:40.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.716+0000 7f16af7fe700 1 -- 172.21.15.88:0/1692847673 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16b80568e0 con 0x7f16c0071470 2024-09-13T18:05:40.721 INFO:teuthology.orchestra.run.smithi088.stdout:55834574855 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 msgr2=0x7fd56c068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 0x7fd56c068cc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd580000f80 tx=0x7fd580009000 comp rx=0 tx=0).stop 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 msgr2=0x7fd588151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c500 tx=0x7fd57800c810 comp rx=0 tx=0).stop 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 shutdown_connections 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd56c066800 0x7fd56c068cc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd588158f90 0x7fd5881e4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd588152dc0 0x7fd5881e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 --2- 172.21.15.88:0/760519978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd58806c300 0x7fd588151180 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 msgr2=0x7f16a4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 >> 172.21.15.88:0/760519978 conn(0x7fd5880664b0 msgr2=0x7fd5880c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 0x7f16a4068c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009d10 tx=0x7f16b4008040 comp rx=0 tx=0).stop 2024-09-13T18:05:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 msgr2=0x7f16c0153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f16b800b370 tx=0x7f16b8004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 shutdown_connections 2024-09-13T18:05:40.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 shutdown_connections 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f16a4066780 0x7f16a4068c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16c0152dc0 0x7f16c01546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f16c0071470 0x7f16c0153c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 --2- 172.21.15.88:0/1692847673 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16c006c300 0x7f16c014f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 >> 172.21.15.88:0/1692847673 conn(0x7f16c00664b0 msgr2=0x7f16c006b680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7fd58e6fa700 1 -- 172.21.15.88:0/760519978 wait complete. 2024-09-13T18:05:40.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 shutdown_connections 2024-09-13T18:05:40.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.720+0000 7f16c51fe700 1 -- 172.21.15.88:0/1692847673 wait complete. 2024-09-13T18:05:40.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-13T18:05:40.735 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-09-13T18:05:40.738 DEBUG:teuthology.parallel:result is None 2024-09-13T18:05:40.738 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:05:40.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:40.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 Processor -- start 2024-09-13T18:05:40.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 -- start start 2024-09-13T18:05:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22b80ccb10 0x7f22b80c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80c6020 con 0x7f22b80c6490 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80c3b30 con 0x7f22b80ccb10 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b7fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80c51a0 con 0x7f22b80ccef0 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22b80ccb10 0x7f22b80c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22b80ccb10 0x7f22b80c34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50684/0 (socket says 172.21.15.88:50684) 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 -- 172.21.15.88:0/1648720570 learned_addr learned my addr 172.21.15.88:0/1648720570 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b67fc700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 -- 172.21.15.88:0/1648720570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 msgr2=0x7f22b80c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b80c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b5ffb700 1 -- 172.21.15.88:0/1648720570 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045039121 0 0) 0x7f22b80c6020 con 0x7f22b80c6490 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 -- 172.21.15.88:0/1648720570 >> v1:172.21.15.94:6789/0 conn(0x7f22b80c6490 legacy=0x7f22b8150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.832+0000 7f22b6ffd700 1 -- 172.21.15.88:0/1648720570 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80c3ff0 con 0x7f22b80ccb10 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b6ffd700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80ccb10 0x7f22b80c34f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009910 tx=0x7f22a8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11d5786764ad64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b5ffb700 1 -- 172.21.15.88:0/1648720570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011830 con 0x7f22b80ccb10 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b5ffb700 1 -- 172.21.15.88:0/1648720570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a8011990 con 0x7f22b80ccb10 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b5ffb700 1 -- 172.21.15.88:0/1648720570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8011d40 con 0x7f22b80ccb10 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- 172.21.15.88:0/1648720570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80ccb10 msgr2=0x7f22b80c34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80ccb10 0x7f22b80c34f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22a8009910 tx=0x7f22a8009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- 172.21.15.88:0/1648720570 shutdown_connections 2024-09-13T18:05:40.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b80c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 --2- 172.21.15.88:0/1648720570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80ccb10 0x7f22b80c34f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- 172.21.15.88:0/1648720570 >> 172.21.15.88:0/1648720570 conn(0x7f22b8066090 msgr2=0x7f22b8066470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- 172.21.15.88:0/1648720570 shutdown_connections 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- 172.21.15.88:0/1648720570 wait complete. 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 Processor -- start 2024-09-13T18:05:40.841 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.836+0000 7f22b7fff700 1 -- start start 2024-09-13T18:05:40.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 0x7f22b8151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b814bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8152480 con 0x7f22b80c6490 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b814cdb0 con 0x7f22b80ccb10 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b814d090 con 0x7f22b80ccef0 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50686/0 (socket says 172.21.15.88:50686) 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 -- 172.21.15.88:0/2084770470 learned_addr learned my addr 172.21.15.88:0/2084770470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b77fe700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b814bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b67fc700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 0x7f22b8151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 -- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 msgr2=0x7f22b814bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b814bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 -- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 msgr2=0x7f22b8151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:40.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 0x7f22b8151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 -- 172.21.15.88:0/2084770470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8009570 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b67fc700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 0x7f22b8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b6ffd700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22b806db20 tx=0x7f22a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800b9f0 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a801f070 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800bd70 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b814d370 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b814d930 con 0x7f22b80c6490 2024-09-13T18:05:40.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.840+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b806ea80 con 0x7f22b80c6490 2024-09-13T18:05:40.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.844+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f22a801a430 con 0x7f22b80c6490 2024-09-13T18:05:40.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.844+0000 7f22af7fe700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 0x7f229c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:40.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.844+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22a8021070 con 0x7f22b80c6490 2024-09-13T18:05:40.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.844+0000 7f22b67fc700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 0x7f229c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:40.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.844+0000 7f22b67fc700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 0x7f229c068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22b80c9050 tx=0x7f22a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:40.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:40.848+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22a8052e00 con 0x7f22b80c6490 2024-09-13T18:05:41.009 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.004+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f22b80c9080 con 0x7f229c066730 2024-09-13T18:05:41.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.020+0000 7f22af7fe700 1 -- 172.21.15.88:0/2084770470 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264678 (secure 0 0 0) 0x7f22b80c9080 con 0x7f229c066730 2024-09-13T18:05:41.027 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 msgr2=0x7f229c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 0x7f229c068bf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f22b80c9050 tx=0x7f22a0008040 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 msgr2=0x7f22b81ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f22b806db20 tx=0x7f22a8004770 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 shutdown_connections 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f229c066730 0x7f229c068bf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22b80ccef0 0x7f22b814bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22b80ccb10 0x7f22b8151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 --2- 172.21.15.88:0/2084770470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22b80c6490 0x7f22b81ef500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 >> 172.21.15.88:0/2084770470 conn(0x7f22b8066090 msgr2=0x7f22b814e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 shutdown_connections 2024-09-13T18:05:41.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.024+0000 7f22b7fff700 1 -- 172.21.15.88:0/2084770470 wait complete. 2024-09-13T18:05:41.031 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:41.045 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:05:40.956820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594088,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238416,"kb_used_data":1808,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736304,"statfs":{"total":773094113280,"available":772849975296,"internally_reserved":0,"allocated":1851392,"data_stored":1741392,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3720,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004743"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'5","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.523637+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:36.523637+0000","last_peered":"2024-09-13T18:05:36.523637+0000","last_clean":"2024-09-13T18:05:36.523637+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:36.523637+0000","last_undegraded":"2024-09-13T18:05:36.523637+0000","last_fullsized":"2024-09-13T18:05:36.523637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.026316+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:30.026316+0000","last_peered":"2024-09-13T18:05:30.026316+0000","last_clean":"2024-09-13T18:05:30.026316+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:30.026316+0000","last_undegraded":"2024-09-13T18:05:30.026316+0000","last_fullsized":"2024-09-13T18:05:30.026316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044702+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:28.044702+0000","last_peered":"2024-09-13T18:05:28.044702+0000","last_clean":"2024-09-13T18:05:28.044702+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:28.044702+0000","last_undegraded":"2024-09-13T18:05:28.044702+0000","last_fullsized":"2024-09-13T18:05:28.044702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516853+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:36.516853+0000","last_peered":"2024-09-13T18:05:36.516853+0000","last_clean":"2024-09-13T18:05:36.516853+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:36.516853+0000","last_undegraded":"2024-09-13T18:05:36.516853+0000","last_fullsized":"2024-09-13T18:05:36.516853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516088+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:36.516088+0000","last_peered":"2024-09-13T18:05:36.516088+0000","last_clean":"2024-09-13T18:05:36.516088+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:36.516088+0000","last_undegraded":"2024-09-13T18:05:36.516088+0000","last_fullsized":"2024-09-13T18:05:36.516088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488549+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:31.488549+0000","last_peered":"2024-09-13T18:05:31.488549+0000","last_clean":"2024-09-13T18:05:31.488549+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:31.488549+0000","last_undegraded":"2024-09-13T18:05:31.488549+0000","last_fullsized":"2024-09-13T18:05:31.488549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518973+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:36.518973+0000","last_peered":"2024-09-13T18:05:36.518973+0000","last_clean":"2024-09-13T18:05:36.518973+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:36.518973+0000","last_undegraded":"2024-09-13T18:05:36.518973+0000","last_fullsized":"2024-09-13T18:05:36.518973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519371+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:36.519371+0000","last_peered":"2024-09-13T18:05:36.519371+0000","last_clean":"2024-09-13T18:05:36.519371+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:36.519371+0000","last_undegraded":"2024-09-13T18:05:36.519371+0000","last_fullsized":"2024-09-13T18:05:36.519371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521855+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:36.521855+0000","last_peered":"2024-09-13T18:05:36.521855+0000","last_clean":"2024-09-13T18:05:36.521855+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:36.521855+0000","last_undegraded":"2024-09-13T18:05:36.521855+0000","last_fullsized":"2024-09-13T18:05:36.521855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'10","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521598+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:36.521598+0000","last_peered":"2024-09-13T18:05:36.521598+0000","last_clean":"2024-09-13T18:05:36.521598+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:36.521598+0000","last_undegraded":"2024-09-13T18:05:36.521598+0000","last_fullsized":"2024-09-13T18:05:36.521598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.041113+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:30.041113+0000","last_peered":"2024-09-13T18:05:30.041113+0000","last_clean":"2024-09-13T18:05:30.041113+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:30.041113+0000","last_undegraded":"2024-09-13T18:05:30.041113+0000","last_fullsized":"2024-09-13T18:05:30.041113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.487627+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:31.487627+0000","last_peered":"2024-09-13T18:05:31.487627+0000","last_clean":"2024-09-13T18:05:31.487627+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:31.487627+0000","last_undegraded":"2024-09-13T18:05:31.487627+0000","last_fullsized":"2024-09-13T18:05:31.487627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482911+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:27.482911+0000","last_peered":"2024-09-13T18:05:27.482911+0000","last_clean":"2024-09-13T18:05:27.482911+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:27.482911+0000","last_undegraded":"2024-09-13T18:05:27.482911+0000","last_fullsized":"2024-09-13T18:05:27.482911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477728+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:26.477728+0000","last_peered":"2024-09-13T18:05:26.477728+0000","last_clean":"2024-09-13T18:05:26.477728+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:26.477728+0000","last_undegraded":"2024-09-13T18:05:26.477728+0000","last_fullsized":"2024-09-13T18:05:26.477728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518922+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:36.518922+0000","last_peered":"2024-09-13T18:05:36.518922+0000","last_clean":"2024-09-13T18:05:36.518922+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:36.518922+0000","last_undegraded":"2024-09-13T18:05:36.518922+0000","last_fullsized":"2024-09-13T18:05:36.518922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032758+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:30.032758+0000","last_peered":"2024-09-13T18:05:30.032758+0000","last_clean":"2024-09-13T18:05:30.032758+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:30.032758+0000","last_undegraded":"2024-09-13T18:05:30.032758+0000","last_fullsized":"2024-09-13T18:05:30.032758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752626+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:27.752626+0000","last_peered":"2024-09-13T18:05:27.752626+0000","last_clean":"2024-09-13T18:05:27.752626+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:27.752626+0000","last_undegraded":"2024-09-13T18:05:27.752626+0000","last_fullsized":"2024-09-13T18:05:27.752626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.033041+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:30.033041+0000","last_peered":"2024-09-13T18:05:30.033041+0000","last_clean":"2024-09-13T18:05:30.033041+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:30.033041+0000","last_undegraded":"2024-09-13T18:05:30.033041+0000","last_fullsized":"2024-09-13T18:05:30.033041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483154+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:27.483154+0000","last_peered":"2024-09-13T18:05:27.483154+0000","last_clean":"2024-09-13T18:05:27.483154+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:27.483154+0000","last_undegraded":"2024-09-13T18:05:27.483154+0000","last_fullsized":"2024-09-13T18:05:27.483154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516383+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:36.516383+0000","last_peered":"2024-09-13T18:05:36.516383+0000","last_clean":"2024-09-13T18:05:36.516383+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:36.516383+0000","last_undegraded":"2024-09-13T18:05:36.516383+0000","last_fullsized":"2024-09-13T18:05:36.516383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519555+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:36.519555+0000","last_peered":"2024-09-13T18:05:36.519555+0000","last_clean":"2024-09-13T18:05:36.519555+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:36.519555+0000","last_undegraded":"2024-09-13T18:05:36.519555+0000","last_fullsized":"2024-09-13T18:05:36.519555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519873+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:36.519873+0000","last_peered":"2024-09-13T18:05:36.519873+0000","last_clean":"2024-09-13T18:05:36.519873+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:36.519873+0000","last_undegraded":"2024-09-13T18:05:36.519873+0000","last_fullsized":"2024-09-13T18:05:36.519873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.480446+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:26.480446+0000","last_peered":"2024-09-13T18:05:26.480446+0000","last_clean":"2024-09-13T18:05:26.480446+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:26.480446+0000","last_undegraded":"2024-09-13T18:05:26.480446+0000","last_fullsized":"2024-09-13T18:05:26.480446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.517844+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:36.517844+0000","last_peered":"2024-09-13T18:05:36.517844+0000","last_clean":"2024-09-13T18:05:36.517844+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:36.517844+0000","last_undegraded":"2024-09-13T18:05:36.517844+0000","last_fullsized":"2024-09-13T18:05:36.517844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483826+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:31.483826+0000","last_peered":"2024-09-13T18:05:31.483826+0000","last_clean":"2024-09-13T18:05:31.483826+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:31.483826+0000","last_undegraded":"2024-09-13T18:05:31.483826+0000","last_fullsized":"2024-09-13T18:05:31.483826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483546+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:31.483546+0000","last_peered":"2024-09-13T18:05:31.483546+0000","last_clean":"2024-09-13T18:05:31.483546+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:31.483546+0000","last_undegraded":"2024-09-13T18:05:31.483546+0000","last_fullsized":"2024-09-13T18:05:31.483546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032250+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:30.032250+0000","last_peered":"2024-09-13T18:05:30.032250+0000","last_clean":"2024-09-13T18:05:30.032250+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:30.032250+0000","last_undegraded":"2024-09-13T18:05:30.032250+0000","last_fullsized":"2024-09-13T18:05:30.032250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488604+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:31.488604+0000","last_peered":"2024-09-13T18:05:31.488604+0000","last_clean":"2024-09-13T18:05:31.488604+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:31.488604+0000","last_undegraded":"2024-09-13T18:05:31.488604+0000","last_fullsized":"2024-09-13T18:05:31.488604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3720,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":69984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":660788,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":217088,"data_stored":70806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":69278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":71290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":69914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":660180,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:41.050 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:41.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 Processor -- start 2024-09-13T18:05:41.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 -- start start 2024-09-13T18:05:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb6600c1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6600729f0 con 0x7fb660155300 2024-09-13T18:05:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb660155990 con 0x7fb66006f110 2024-09-13T18:05:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb665273700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601557b0 con 0x7fb66006f4f0 2024-09-13T18:05:41.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb664a72700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb660155300 0x7fb6600c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45812/0 (socket says 172.21.15.88:45812) 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb664a72700 1 -- 172.21.15.88:0/1329330570 learned_addr learned my addr 172.21.15.88:0/1329330570 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb6600c1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320185717 0 0) 0x7fb6600729f0 con 0x7fb660155300 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6480046e0 con 0x7fb660155300 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1936509082 0 0) 0x7fb6480046e0 con 0x7fb660155300 2024-09-13T18:05:41.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 msgr2=0x7fb6600c1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb6600c1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 >> v1:172.21.15.94:6789/0 conn(0x7fb66006f110 legacy=0x7fb660152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb660156210 con 0x7fb660155300 2024-09-13T18:05:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fb654001670 con 0x7fb660155300 2024-09-13T18:05:41.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.156+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 >> v1:172.21.15.88:6789/0 conn(0x7fb660155300 legacy=0x7fb6600c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb648004b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb648005980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb648005ec0 0x7fb648006340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6601557b0 con 0x7fb6480050a0 2024-09-13T18:05:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64800cb70 con 0x7fb648005ec0 2024-09-13T18:05:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb648005980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64800cd30 con 0x7fb66006f4f0 2024-09-13T18:05:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65ffff700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb648004b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb664a72700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb648005ec0 0x7fb648006340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 -- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 msgr2=0x7fb648004b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb66006f4f0 0x7fb648004b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 -- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb648005ec0 msgr2=0x7fb648006340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb648005ec0 0x7fb648006340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 -- 172.21.15.88:0/1329330570 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480046e0 con 0x7fb6480050a0 2024-09-13T18:05:41.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb664a72700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb648005ec0 0x7fb648006340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb648005980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb650009fc0 tx=0x7fb6480069b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc29a0953137b9ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000ec30 con 0x7fb6480050a0 2024-09-13T18:05:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000f040 con 0x7fb6480050a0 2024-09-13T18:05:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb65effd700 1 -- 172.21.15.88:0/1329330570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650014480 con 0x7fb6480050a0 2024-09-13T18:05:41.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 -- 172.21.15.88:0/1329330570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 msgr2=0x7fb648005980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 --2- 172.21.15.88:0/1329330570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb648005980 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb650009fc0 tx=0x7fb6480069b0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb664a72700 1 -- 172.21.15.88:0/1329330570 reap_dead start 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 -- 172.21.15.88:0/1329330570 shutdown_connections 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 -- 172.21.15.88:0/1329330570 >> 172.21.15.88:0/1329330570 conn(0x7fb6600ca720 msgr2=0x7fb6600cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 -- 172.21.15.88:0/1329330570 shutdown_connections 2024-09-13T18:05:41.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.160+0000 7fb665273700 1 -- 172.21.15.88:0/1329330570 wait complete. 2024-09-13T18:05:41.178 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 Processor -- start 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- start start 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6601545e0 0x7fb660154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6600c8d70 0x7fb6600c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb660154f40 con 0x7fb6480050a0 2024-09-13T18:05:41.179 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c8600 con 0x7fb6601545e0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6600c88e0 con 0x7fb6600c8d70 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50694/0 (socket says 172.21.15.88:50694) 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 -- 172.21.15.88:0/675334950 learned_addr learned my addr 172.21.15.88:0/675334950 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6601545e0 0x7fb660154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb664a72700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6600c8d70 0x7fb6600c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 -- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6600c8d70 msgr2=0x7fb6600c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6600c8d70 0x7fb6600c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 -- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6601545e0 msgr2=0x7fb660154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6601545e0 0x7fb660154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 -- 172.21.15.88:0/675334950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6600c9730 con 0x7fb6480050a0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65ffff700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6580119d0 tx=0x7fb658011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658001480 con 0x7fb6480050a0 2024-09-13T18:05:41.180 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6580054e0 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65800fa90 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6600c6e80 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.164+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6600c7440 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6600c2bb0 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb658018020 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb65cff9700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 0x7fb64c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb658086010 con 0x7fb6480050a0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 0x7fb64c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.181 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.168+0000 7fb65f7fe700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 0x7fb64c068c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6600c4980 tx=0x7fb650013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.176+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb6580532f0 con 0x7fb6480050a0 2024-09-13T18:05:41.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.324+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6600c3120 con 0x7fb64c066760 2024-09-13T18:05:41.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.340+0000 7fb65cff9700 1 -- 172.21.15.88:0/675334950 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264678 (secure 0 0 0) 0x7fb650003d40 con 0x7fb64c066760 2024-09-13T18:05:41.343 INFO:tasks.ceph.mds.d.smithi094.stderr:2024-09-13T18:05:41.334+0000 7f7ae2990700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:05:41.344 INFO:tasks.ceph.mds.d.smithi094.stderr:2024-09-13T18:05:41.334+0000 7f7ae2990700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-13T18:05:41.348 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 msgr2=0x7fb64c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 0x7fb64c068c20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb6600c4980 tx=0x7fb650013000 comp rx=0 tx=0).stop 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 msgr2=0x7fb66006cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fb6580119d0 tx=0x7fb658011d90 comp rx=0 tx=0).stop 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 shutdown_connections 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb64c066760 0x7fb64c068c20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6600c8d70 0x7fb6600c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6601545e0 0x7fb660154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 --2- 172.21.15.88:0/675334950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6480050a0 0x7fb66006cf00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 >> 172.21.15.88:0/675334950 conn(0x7fb6600ca720 msgr2=0x7fb6601526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 shutdown_connections 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.344+0000 7fb665273700 1 -- 172.21.15.88:0/675334950 wait complete. 2024-09-13T18:05:41.351 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:41.361 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:05:40.956820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594088,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":243,"num_write_kb":2442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":190,"ondisk_log_size":190,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238416,"kb_used_data":1808,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736304,"statfs":{"total":773094113280,"available":772849975296,"internally_reserved":0,"allocated":1851392,"data_stored":1741392,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3720,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004743"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'5","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.523637+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:36.523637+0000","last_peered":"2024-09-13T18:05:36.523637+0000","last_clean":"2024-09-13T18:05:36.523637+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:36.523637+0000","last_undegraded":"2024-09-13T18:05:36.523637+0000","last_fullsized":"2024-09-13T18:05:36.523637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.026316+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:30.026316+0000","last_peered":"2024-09-13T18:05:30.026316+0000","last_clean":"2024-09-13T18:05:30.026316+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:30.026316+0000","last_undegraded":"2024-09-13T18:05:30.026316+0000","last_fullsized":"2024-09-13T18:05:30.026316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755013+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:27.755013+0000","last_peered":"2024-09-13T18:05:27.755013+0000","last_clean":"2024-09-13T18:05:27.755013+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:27.755013+0000","last_undegraded":"2024-09-13T18:05:27.755013+0000","last_fullsized":"2024-09-13T18:05:27.755013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044702+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:28.044702+0000","last_peered":"2024-09-13T18:05:28.044702+0000","last_clean":"2024-09-13T18:05:28.044702+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:28.044702+0000","last_undegraded":"2024-09-13T18:05:28.044702+0000","last_fullsized":"2024-09-13T18:05:28.044702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516853+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:36.516853+0000","last_peered":"2024-09-13T18:05:36.516853+0000","last_clean":"2024-09-13T18:05:36.516853+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:36.516853+0000","last_undegraded":"2024-09-13T18:05:36.516853+0000","last_fullsized":"2024-09-13T18:05:36.516853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516088+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:36.516088+0000","last_peered":"2024-09-13T18:05:36.516088+0000","last_clean":"2024-09-13T18:05:36.516088+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:36.516088+0000","last_undegraded":"2024-09-13T18:05:36.516088+0000","last_fullsized":"2024-09-13T18:05:36.516088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488549+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:31.488549+0000","last_peered":"2024-09-13T18:05:31.488549+0000","last_clean":"2024-09-13T18:05:31.488549+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:31.488549+0000","last_undegraded":"2024-09-13T18:05:31.488549+0000","last_fullsized":"2024-09-13T18:05:31.488549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518973+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:36.518973+0000","last_peered":"2024-09-13T18:05:36.518973+0000","last_clean":"2024-09-13T18:05:36.518973+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:36.518973+0000","last_undegraded":"2024-09-13T18:05:36.518973+0000","last_fullsized":"2024-09-13T18:05:36.518973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519371+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:36.519371+0000","last_peered":"2024-09-13T18:05:36.519371+0000","last_clean":"2024-09-13T18:05:36.519371+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:36.519371+0000","last_undegraded":"2024-09-13T18:05:36.519371+0000","last_fullsized":"2024-09-13T18:05:36.519371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521855+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:36.521855+0000","last_peered":"2024-09-13T18:05:36.521855+0000","last_clean":"2024-09-13T18:05:36.521855+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:36.521855+0000","last_undegraded":"2024-09-13T18:05:36.521855+0000","last_fullsized":"2024-09-13T18:05:36.521855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750458+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:27.750458+0000","last_peered":"2024-09-13T18:05:27.750458+0000","last_clean":"2024-09-13T18:05:27.750458+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:27.750458+0000","last_undegraded":"2024-09-13T18:05:27.750458+0000","last_fullsized":"2024-09-13T18:05:27.750458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'10","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521598+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:36.521598+0000","last_peered":"2024-09-13T18:05:36.521598+0000","last_clean":"2024-09-13T18:05:36.521598+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:36.521598+0000","last_undegraded":"2024-09-13T18:05:36.521598+0000","last_fullsized":"2024-09-13T18:05:36.521598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.041113+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:30.041113+0000","last_peered":"2024-09-13T18:05:30.041113+0000","last_clean":"2024-09-13T18:05:30.041113+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:30.041113+0000","last_undegraded":"2024-09-13T18:05:30.041113+0000","last_fullsized":"2024-09-13T18:05:30.041113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.487627+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:31.487627+0000","last_peered":"2024-09-13T18:05:31.487627+0000","last_clean":"2024-09-13T18:05:31.487627+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:31.487627+0000","last_undegraded":"2024-09-13T18:05:31.487627+0000","last_fullsized":"2024-09-13T18:05:31.487627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482911+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:27.482911+0000","last_peered":"2024-09-13T18:05:27.482911+0000","last_clean":"2024-09-13T18:05:27.482911+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:27.482911+0000","last_undegraded":"2024-09-13T18:05:27.482911+0000","last_fullsized":"2024-09-13T18:05:27.482911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.477728+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:26.477728+0000","last_peered":"2024-09-13T18:05:26.477728+0000","last_clean":"2024-09-13T18:05:26.477728+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:26.477728+0000","last_undegraded":"2024-09-13T18:05:26.477728+0000","last_fullsized":"2024-09-13T18:05:26.477728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518922+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:36.518922+0000","last_peered":"2024-09-13T18:05:36.518922+0000","last_clean":"2024-09-13T18:05:36.518922+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:36.518922+0000","last_undegraded":"2024-09-13T18:05:36.518922+0000","last_fullsized":"2024-09-13T18:05:36.518922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032758+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:30.032758+0000","last_peered":"2024-09-13T18:05:30.032758+0000","last_clean":"2024-09-13T18:05:30.032758+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:30.032758+0000","last_undegraded":"2024-09-13T18:05:30.032758+0000","last_fullsized":"2024-09-13T18:05:30.032758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752626+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:27.752626+0000","last_peered":"2024-09-13T18:05:27.752626+0000","last_clean":"2024-09-13T18:05:27.752626+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:27.752626+0000","last_undegraded":"2024-09-13T18:05:27.752626+0000","last_fullsized":"2024-09-13T18:05:27.752626+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748002+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:27.748002+0000","last_peered":"2024-09-13T18:05:27.748002+0000","last_clean":"2024-09-13T18:05:27.748002+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:27.748002+0000","last_undegraded":"2024-09-13T18:05:27.748002+0000","last_fullsized":"2024-09-13T18:05:27.748002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.033041+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:30.033041+0000","last_peered":"2024-09-13T18:05:30.033041+0000","last_clean":"2024-09-13T18:05:30.033041+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:30.033041+0000","last_undegraded":"2024-09-13T18:05:30.033041+0000","last_fullsized":"2024-09-13T18:05:30.033041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483154+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:27.483154+0000","last_peered":"2024-09-13T18:05:27.483154+0000","last_clean":"2024-09-13T18:05:27.483154+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:27.483154+0000","last_undegraded":"2024-09-13T18:05:27.483154+0000","last_fullsized":"2024-09-13T18:05:27.483154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516383+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:36.516383+0000","last_peered":"2024-09-13T18:05:36.516383+0000","last_clean":"2024-09-13T18:05:36.516383+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:36.516383+0000","last_undegraded":"2024-09-13T18:05:36.516383+0000","last_fullsized":"2024-09-13T18:05:36.516383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519555+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:36.519555+0000","last_peered":"2024-09-13T18:05:36.519555+0000","last_clean":"2024-09-13T18:05:36.519555+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:36.519555+0000","last_undegraded":"2024-09-13T18:05:36.519555+0000","last_fullsized":"2024-09-13T18:05:36.519555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519873+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:36.519873+0000","last_peered":"2024-09-13T18:05:36.519873+0000","last_clean":"2024-09-13T18:05:36.519873+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:36.519873+0000","last_undegraded":"2024-09-13T18:05:36.519873+0000","last_fullsized":"2024-09-13T18:05:36.519873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.480446+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:26.480446+0000","last_peered":"2024-09-13T18:05:26.480446+0000","last_clean":"2024-09-13T18:05:26.480446+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:26.480446+0000","last_undegraded":"2024-09-13T18:05:26.480446+0000","last_fullsized":"2024-09-13T18:05:26.480446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.517844+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:36.517844+0000","last_peered":"2024-09-13T18:05:36.517844+0000","last_clean":"2024-09-13T18:05:36.517844+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:36.517844+0000","last_undegraded":"2024-09-13T18:05:36.517844+0000","last_fullsized":"2024-09-13T18:05:36.517844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483826+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:31.483826+0000","last_peered":"2024-09-13T18:05:31.483826+0000","last_clean":"2024-09-13T18:05:31.483826+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:31.483826+0000","last_undegraded":"2024-09-13T18:05:31.483826+0000","last_fullsized":"2024-09-13T18:05:31.483826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483546+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:31.483546+0000","last_peered":"2024-09-13T18:05:31.483546+0000","last_clean":"2024-09-13T18:05:31.483546+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:31.483546+0000","last_undegraded":"2024-09-13T18:05:31.483546+0000","last_fullsized":"2024-09-13T18:05:31.483546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.032250+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:30.032250+0000","last_peered":"2024-09-13T18:05:30.032250+0000","last_clean":"2024-09-13T18:05:30.032250+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:30.032250+0000","last_undegraded":"2024-09-13T18:05:30.032250+0000","last_fullsized":"2024-09-13T18:05:30.032250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488604+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:31.488604+0000","last_peered":"2024-09-13T18:05:31.488604+0000","last_clean":"2024-09-13T18:05:31.488604+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:31.488604+0000","last_undegraded":"2024-09-13T18:05:31.488604+0000","last_fullsized":"2024-09-13T18:05:31.488604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3720,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":196,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":200704,"data_stored":69152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.353}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":69984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":660788,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":217088,"data_stored":70806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":69278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":71290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31320,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340520,"statfs":{"total":96636764160,"available":96604692480,"internally_reserved":0,"allocated":212992,"data_stored":69914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":660180,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:41.367 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:05:41.367 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:05:41.367 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:05:41.367 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:05:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 Processor -- start 2024-09-13T18:05:41.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 -- start start 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 0x7fae140c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae141613e0 0x7fae14071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae140c1db0 con 0x7fae140c1f70 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae14160f50 con 0x7fae141613e0 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.468+0000 7fae19215700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae140c5b40 con 0x7fae141574b0 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae18a14700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fae140c1f70 0x7fae1406eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45814/0 (socket says 172.21.15.88:45814) 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae18a14700 1 -- 172.21.15.88:0/3631772284 learned_addr learned my addr 172.21.15.88:0/3631772284 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 --2- 172.21.15.88:0/3631772284 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 0x7fae140c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae137fe700 1 --2- 172.21.15.88:0/3631772284 >> v2:172.21.15.94:3300/0 conn(0x7fae141613e0 0x7fae14071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae12ffd700 1 -- 172.21.15.88:0/3631772284 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504907844 0 0) 0x7fae04001110 con 0x7fae140c1f70 2024-09-13T18:05:41.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae12ffd700 1 -- 172.21.15.88:0/3631772284 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae000035d0 con 0x7fae140c1f70 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 -- 172.21.15.88:0/3631772284 >> v2:172.21.15.94:3300/0 conn(0x7fae141613e0 msgr2=0x7fae14071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 --2- 172.21.15.88:0/3631772284 >> v2:172.21.15.94:3300/0 conn(0x7fae141613e0 0x7fae14071720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 -- 172.21.15.88:0/3631772284 >> v1:172.21.15.88:6789/0 conn(0x7fae140c1f70 legacy=0x7fae1406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 -- 172.21.15.88:0/3631772284 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae140c1630 con 0x7fae141574b0 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae13fff700 1 --2- 172.21.15.88:0/3631772284 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 0x7fae140c5600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae140c1820 tx=0x7fae0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b290c81bb4eb2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae12ffd700 1 -- 172.21.15.88:0/3631772284 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c016070 con 0x7fae141574b0 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae12ffd700 1 -- 172.21.15.88:0/3631772284 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0c00bae0 con 0x7fae141574b0 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae12ffd700 1 -- 172.21.15.88:0/3631772284 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0c00e070 con 0x7fae141574b0 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- 172.21.15.88:0/3631772284 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 msgr2=0x7fae140c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 --2- 172.21.15.88:0/3631772284 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 0x7fae140c5600 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fae140c1820 tx=0x7fae0c00b330 comp rx=0 tx=0).stop 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- 172.21.15.88:0/3631772284 shutdown_connections 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 --2- 172.21.15.88:0/3631772284 >> v2:172.21.15.94:3300/0 conn(0x7fae141613e0 0x7fae14071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 --2- 172.21.15.88:0/3631772284 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141574b0 0x7fae140c5600 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- 172.21.15.88:0/3631772284 >> 172.21.15.88:0/3631772284 conn(0x7fae140ca720 msgr2=0x7fae140cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- 172.21.15.88:0/3631772284 shutdown_connections 2024-09-13T18:05:41.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- 172.21.15.88:0/3631772284 wait complete. 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 Processor -- start 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.472+0000 7fae19215700 1 -- start start 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae140c1f70 0x7fae14154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141613e0 0x7fae141f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae141f6ee0 con 0x7fae141574b0 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae14154020 con 0x7fae140c1f70 2024-09-13T18:05:41.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae141f6c20 con 0x7fae141613e0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50710/0 (socket says 172.21.15.88:50710) 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 -- 172.21.15.88:0/3224606604 learned_addr learned my addr 172.21.15.88:0/3224606604 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae13fff700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae140c1f70 0x7fae14154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae18a14700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141613e0 0x7fae141f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 -- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141613e0 msgr2=0x7fae141f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141613e0 0x7fae141f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 -- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae140c1f70 msgr2=0x7fae14154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae140c1f70 0x7fae14154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 -- 172.21.15.88:0/3224606604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c009a70 con 0x7fae141574b0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae137fe700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e840 tx=0x7fadfc00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0095a0 con 0x7fae141574b0 2024-09-13T18:05:41.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc013680 con 0x7fae141574b0 2024-09-13T18:05:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae14153680 con 0x7fae141574b0 2024-09-13T18:05:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc013a10 con 0x7fae141574b0 2024-09-13T18:05:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae14153c40 con 0x7fae141574b0 2024-09-13T18:05:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae14153e00 con 0x7fae141574b0 2024-09-13T18:05:41.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.476+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadfc013b70 con 0x7fae141574b0 2024-09-13T18:05:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.480+0000 7fae10ff9700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 0x7fadf4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.480+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadfc083f10 con 0x7fae141574b0 2024-09-13T18:05:41.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.480+0000 7fae13fff700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 0x7fadf4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.480+0000 7fae13fff700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 0x7fadf4068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000f80 tx=0x7fae0c011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.488+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fadfc051290 con 0x7fae141574b0 2024-09-13T18:05:41.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fae14154160 con 0x7fae141574b0 2024-09-13T18:05:41.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae10ff9700 1 -- 172.21.15.88:0/3224606604 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fae14154160 con 0x7fae141574b0 2024-09-13T18:05:41.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:41.683 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 msgr2=0x7fadf4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 0x7fadf4068bf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fae0c000f80 tx=0x7fae0c011000 comp rx=0 tx=0).stop 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 msgr2=0x7fae141f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00e840 tx=0x7fadfc00eb50 comp rx=0 tx=0).stop 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 shutdown_connections 2024-09-13T18:05:41.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fadf4066730 0x7fadf4068bf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae141613e0 0x7fae141f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae141574b0 0x7fae141f3f80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 --2- 172.21.15.88:0/3224606604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae140c1f70 0x7fae14154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 >> 172.21.15.88:0/3224606604 conn(0x7fae140ca720 msgr2=0x7fae14150d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 shutdown_connections 2024-09-13T18:05:41.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.680+0000 7fae19215700 1 -- 172.21.15.88:0/3224606604 wait complete. 2024-09-13T18:05:41.697 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:05:41.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:41.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.796+0000 7f1ab0f8b700 1 Processor -- start 2024-09-13T18:05:41.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.796+0000 7f1ab0f8b700 1 -- start start 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1aa40d5640 0x7f1aa4045700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1aa40464b0 0x7f1aa4045c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aa40d5a20 con 0x7f1aa4050820 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40dbe40 con 0x7f1aa40d5640 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa40dc120 con 0x7f1aa40464b0 2024-09-13T18:05:41.806 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1aa40d5640 0x7f1aa4045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaaffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1aa4050820 0x7f1aa4034b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45822/0 (socket says 172.21.15.88:45822) 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaaffd700 1 -- 172.21.15.88:0/3417476451 learned_addr learned my addr 172.21.15.88:0/3417476451 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aabfff700 1 --2- 172.21.15.88:0/3417476451 >> v2:172.21.15.94:3300/0 conn(0x7f1aa40464b0 0x7f1aa4045c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 -- 172.21.15.88:0/3417476451 >> v2:172.21.15.94:3300/0 conn(0x7f1aa40464b0 msgr2=0x7f1aa4045c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 --2- 172.21.15.88:0/3417476451 >> v2:172.21.15.94:3300/0 conn(0x7f1aa40464b0 0x7f1aa4045c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 -- 172.21.15.88:0/3417476451 >> v1:172.21.15.88:6789/0 conn(0x7f1aa4050820 legacy=0x7f1aa4034b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaa7fc700 1 -- 172.21.15.88:0/3417476451 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033601155 0 0) 0x7f1aa40d5a20 con 0x7f1aa4050820 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 -- 172.21.15.88:0/3417476451 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4005b00 con 0x7f1aa40d5640 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aab7fe700 1 --2- 172.21.15.88:0/3417476451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa4045700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40095d0 tx=0x7f1a98009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35401dd533fa7aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaa7fc700 1 -- 172.21.15.88:0/3417476451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011830 con 0x7f1aa40d5640 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaa7fc700 1 -- 172.21.15.88:0/3417476451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a98011990 con 0x7f1aa40d5640 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1aaa7fc700 1 -- 172.21.15.88:0/3417476451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a98011d40 con 0x7f1aa40d5640 2024-09-13T18:05:41.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3417476451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 msgr2=0x7f1aa4045700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3417476451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa4045700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40095d0 tx=0x7f1a98009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3417476451 shutdown_connections 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3417476451 >> v2:172.21.15.94:3300/0 conn(0x7f1aa40464b0 0x7f1aa4045c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3417476451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa4045700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3417476451 >> 172.21.15.88:0/3417476451 conn(0x7f1aa404fd00 msgr2=0x7f1aa4050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3417476451 shutdown_connections 2024-09-13T18:05:41.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.800+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3417476451 wait complete. 2024-09-13T18:05:41.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 Processor -- start 2024-09-13T18:05:41.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- start start 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1aa40464b0 0x7f1aa404b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1aa4050820 0x7f1aa40cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40ce990 con 0x7f1aa40d5640 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4172de0 con 0x7f1aa40464b0 2024-09-13T18:05:41.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa4173310 con 0x7f1aa4050820 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50714/0 (socket says 172.21.15.88:50714) 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 -- 172.21.15.88:0/3259265677 learned_addr learned my addr 172.21.15.88:0/3259265677 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aaaffd700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1aa4050820 0x7f1aa40cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aab7fe700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1aa40464b0 0x7f1aa404b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 -- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1aa4050820 msgr2=0x7f1aa40cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1aa4050820 0x7f1aa40cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 -- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1aa40464b0 msgr2=0x7f1aa404b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1aa40464b0 0x7f1aa404b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 -- 172.21.15.88:0/3259265677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a980094b0 con 0x7f1aa40d5640 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1aabfff700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1aac073020 tx=0x7f1aac074690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac068610 con 0x7f1aa40d5640 2024-09-13T18:05:41.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac067ae0 con 0x7f1aa40d5640 2024-09-13T18:05:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aa40dd3c0 con 0x7f1aa40d5640 2024-09-13T18:05:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aac067eb0 con 0x7f1aa40d5640 2024-09-13T18:05:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa4173030 con 0x7f1aa40d5640 2024-09-13T18:05:41.813 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.804+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa40cead0 con 0x7f1aa40d5640 2024-09-13T18:05:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.808+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1aac0720c0 con 0x7f1aa40d5640 2024-09-13T18:05:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.808+0000 7f1a97fff700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 0x7f1a90068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.808+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1aac0fe3c0 con 0x7f1aa40d5640 2024-09-13T18:05:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.808+0000 7f1aab7fe700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 0x7f1a90068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:41.814 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.808+0000 7f1aab7fe700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 0x7f1a90068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a980090b0 tx=0x7f1a9801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:41.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.816+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1aa40cead0 con 0x7f1aa40d5640 2024-09-13T18:05:41.979 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.976+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aa40cead0 con 0x7f1aa40d5640 2024-09-13T18:05:41.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.976+0000 7f1a97fff700 1 -- 172.21.15.88:0/3259265677 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1aa40cead0 con 0x7f1aa40d5640 2024-09-13T18:05:41.982 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:41.983 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 msgr2=0x7f1a90068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 0x7f1a90068bf0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a980090b0 tx=0x7f1a9801c040 comp rx=0 tx=0).stop 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 msgr2=0x7f1aa40cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1aac073020 tx=0x7f1aac074690 comp rx=0 tx=0).stop 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 shutdown_connections 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a90066730 0x7f1a90068bf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1aa4050820 0x7f1aa40cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1aa40d5640 0x7f1aa40cd570 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 --2- 172.21.15.88:0/3259265677 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1aa40464b0 0x7f1aa404b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 >> 172.21.15.88:0/3259265677 conn(0x7f1aa404fd00 msgr2=0x7f1aa404ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 shutdown_connections 2024-09-13T18:05:41.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:41.980+0000 7f1ab0f8b700 1 -- 172.21.15.88:0/3259265677 wait complete. 2024-09-13T18:05:41.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:41.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 Processor -- start 2024-09-13T18:05:42.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 -- start start 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a41532c0 0x7f82a4159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82a4066450 0x7f82a4163760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a40c6e70 con 0x7f82a40c0520 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a4159230 con 0x7f82a4066450 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a3fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c7150 con 0x7f82a41532c0 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a27fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82a40c0520 0x7f82a40c09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45836/0 (socket says 172.21.15.88:45836) 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82a4066450 0x7f82a4163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a27fc700 1 -- 172.21.15.88:0/3654405765 learned_addr learned my addr 172.21.15.88:0/3654405765 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a2ffd700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a41532c0 0x7f82a4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a37fe700 1 -- 172.21.15.88:0/3654405765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a41532c0 msgr2=0x7f82a4159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a37fe700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a41532c0 0x7f82a4159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a37fe700 1 -- 172.21.15.88:0/3654405765 >> v1:172.21.15.88:6789/0 conn(0x7f82a40c0520 legacy=0x7f82a40c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a1ffb700 1 -- 172.21.15.88:0/3654405765 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576856534 0 0) 0x7f82a40c6e70 con 0x7f82a40c0520 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.112+0000 7f82a37fe700 1 -- 172.21.15.88:0/3654405765 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40c7430 con 0x7f82a4066450 2024-09-13T18:05:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a37fe700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a4066450 0x7f82a4163760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78dde7147d660da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a1ffb700 1 -- 172.21.15.88:0/3654405765 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c00e070 con 0x7f82a4066450 2024-09-13T18:05:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a1ffb700 1 -- 172.21.15.88:0/3654405765 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c00bb20 con 0x7f82a4066450 2024-09-13T18:05:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a1ffb700 1 -- 172.21.15.88:0/3654405765 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c012430 con 0x7f82a4066450 2024-09-13T18:05:42.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- 172.21.15.88:0/3654405765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a4066450 msgr2=0x7f82a4163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a4066450 0x7f82a4163760 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f829c009d90 tx=0x7f829c00b330 comp rx=0 tx=0).stop 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- 172.21.15.88:0/3654405765 shutdown_connections 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a4066450 0x7f82a4163760 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3654405765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a41532c0 0x7f82a4159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- 172.21.15.88:0/3654405765 >> 172.21.15.88:0/3654405765 conn(0x7f82a40c7a40 msgr2=0x7f82a40c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- 172.21.15.88:0/3654405765 shutdown_connections 2024-09-13T18:05:42.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- 172.21.15.88:0/3654405765 wait complete. 2024-09-13T18:05:42.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 Processor -- start 2024-09-13T18:05:42.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.116+0000 7f82a3fff700 1 -- start start 2024-09-13T18:05:42.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82a4066450 0x7f82a41f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a40c0520 0x7f82a4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a406f020 con 0x7f82a41532c0 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41eea40 con 0x7f82a4066450 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40c2f60 con 0x7f82a40c0520 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a27fc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a40c0520 0x7f82a4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a2ffd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82a4066450 0x7f82a41f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50738/0 (socket says 172.21.15.88:50738) 2024-09-13T18:05:42.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 -- 172.21.15.88:0/3112496878 learned_addr learned my addr 172.21.15.88:0/3112496878 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:42.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 -- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a40c0520 msgr2=0x7f82a4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a40c0520 0x7f82a4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 -- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82a4066450 msgr2=0x7f82a41f29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82a4066450 0x7f82a41f29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 -- 172.21.15.88:0/3112496878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c009a70 con 0x7f82a41532c0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a37fe700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f829c013000 tx=0x7f829c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c012430 con 0x7f82a41532c0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c020070 con 0x7f82a41532c0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a41f2f00 con 0x7f82a41532c0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c004280 con 0x7f82a41532c0 2024-09-13T18:05:42.126 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.120+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40c2420 con 0x7f82a41532c0 2024-09-13T18:05:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40ca620 con 0x7f82a41532c0 2024-09-13T18:05:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f829c0043e0 con 0x7f82a41532c0 2024-09-13T18:05:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f828b7fe700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 0x7f8290068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f829c022070 con 0x7f82a41532c0 2024-09-13T18:05:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f82a2ffd700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 0x7f8290068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.129 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.124+0000 7f82a2ffd700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 0x7f8290068c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8294009b50 tx=0x7f8294009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.128+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f829c052b10 con 0x7f82a41532c0 2024-09-13T18:05:42.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82a41f2f00 con 0x7f82a41532c0 2024-09-13T18:05:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f828b7fe700 1 -- 172.21.15.88:0/3112496878 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82a41f2f00 con 0x7f82a41532c0 2024-09-13T18:05:42.299 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 msgr2=0x7f8290068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 0x7f8290068c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8294009b50 tx=0x7f8294009240 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 msgr2=0x7f82a41ef170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f829c013000 tx=0x7f829c004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 shutdown_connections 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8290066760 0x7f8290068c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f82a40c0520 0x7f82a4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a41532c0 0x7f82a41ef170 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 --2- 172.21.15.88:0/3112496878 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f82a4066450 0x7f82a41f29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 >> 172.21.15.88:0/3112496878 conn(0x7f82a40c7a40 msgr2=0x7f82a40c0970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 shutdown_connections 2024-09-13T18:05:42.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.296+0000 7f82a3fff700 1 -- 172.21.15.88:0/3112496878 wait complete. 2024-09-13T18:05:42.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:05:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 Processor -- start 2024-09-13T18:05:42.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 -- start start 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51e40cbe70 0x7f51e415c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51e4152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e4159e60 con 0x7f51e40cba90 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e4159a40 con 0x7f51e40cbe70 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ebcc0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4070bb0 con 0x7f51e415cac0 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e9a5c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51e40cba90 0x7f51e40703e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45852/0 (socket says 172.21.15.88:45852) 2024-09-13T18:05:42.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e9a5c700 1 -- 172.21.15.88:0/327096635 learned_addr learned my addr 172.21.15.88:0/327096635 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e925b700 1 --2- 172.21.15.88:0/327096635 >> v2:172.21.15.94:3300/0 conn(0x7f51e40cbe70 0x7f51e415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ea25d700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51e4152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855595618 0 0) 0x7f51e4159e60 con 0x7f51e40cba90 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51d00035d0 con 0x7f51e40cba90 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1514930532 0 0) 0x7f51d00035d0 con 0x7f51e40cba90 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 msgr2=0x7f51e4152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51e4152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 >> v2:172.21.15.94:3300/0 conn(0x7f51e40cbe70 msgr2=0x7f51e415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 --2- 172.21.15.88:0/327096635 >> v2:172.21.15.94:3300/0 conn(0x7f51e40cbe70 0x7f51e415c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4070e90 con 0x7f51e40cba90 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f51e0001670 con 0x7f51e40cba90 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 >> v1:172.21.15.88:6789/0 conn(0x7f51e40cba90 legacy=0x7f51e40703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51d0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51d0004870 0x7f51d0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51d0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4159a40 con 0x7f51d0003a20 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4070bb0 con 0x7f51d0004870 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d000ba30 con 0x7f51e415cac0 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51d0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51ea25d700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51d0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.432+0000 7f51e925b700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51d0004870 0x7f51d0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 -- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 msgr2=0x7f51d0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e415cac0 0x7f51d0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 -- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51d0004870 msgr2=0x7f51d0004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51d0004870 0x7f51d0004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 -- 172.21.15.88:0/327096635 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d00035d0 con 0x7f51d0003a20 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51d0003e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c320 tx=0x7f51d00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4338ff25190afb3f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e000ce60 con 0x7f51d0003a20 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0005980 con 0x7f51d0003a20 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51e8a5a700 1 -- 172.21.15.88:0/327096635 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0005d10 con 0x7f51d0003a20 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- 172.21.15.88:0/327096635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 msgr2=0x7f51d0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/327096635 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51d0003e40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c320 tx=0x7f51d00058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ea25d700 1 -- 172.21.15.88:0/327096635 reap_dead start 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- 172.21.15.88:0/327096635 shutdown_connections 2024-09-13T18:05:42.443 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- 172.21.15.88:0/327096635 >> 172.21.15.88:0/327096635 conn(0x7f51e4071790 msgr2=0x7f51e4071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- 172.21.15.88:0/327096635 shutdown_connections 2024-09-13T18:05:42.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- 172.21.15.88:0/327096635 wait complete. 2024-09-13T18:05:42.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 Processor -- start 2024-09-13T18:05:42.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.436+0000 7f51ebcc0700 1 -- start start 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e40c8860 0x7f51e4153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e4154270 0x7f51e41f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4153150 con 0x7f51d0003a20 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e414d030 con 0x7f51e4154270 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41546f0 con 0x7f51e40c8860 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50770/0 (socket says 172.21.15.88:50770) 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 -- 172.21.15.88:0/1025720412 learned_addr learned my addr 172.21.15.88:0/1025720412 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ea25d700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e4154270 0x7f51e41f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e925b700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e40c8860 0x7f51e4153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 -- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e40c8860 msgr2=0x7f51e4153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e40c8860 0x7f51e4153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 -- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e4154270 msgr2=0x7f51e41f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e4154270 0x7f51e41f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 -- 172.21.15.88:0/1025720412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e41f2730 con 0x7f51d0003a20 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51e9a5c700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c910 tx=0x7f51e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0001680 con 0x7f51d0003a20 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51e0004aa0 con 0x7f51d0003a20 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4152b90 con 0x7f51d0003a20 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0004e50 con 0x7f51d0003a20 2024-09-13T18:05:42.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e41558c0 con 0x7f51d0003a20 2024-09-13T18:05:42.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.440+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e4155720 con 0x7f51d0003a20 2024-09-13T18:05:42.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.444+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f51e00070d0 con 0x7f51d0003a20 2024-09-13T18:05:42.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.444+0000 7f51da7fc700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 0x7f51c8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.444+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51e0085800 con 0x7f51d0003a20 2024-09-13T18:05:42.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.444+0000 7f51e925b700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 0x7f51c8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.444+0000 7f51e925b700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 0x7f51c8068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51e40b3c90 tx=0x7f51d4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.452+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f51e4155720 con 0x7f51d0003a20 2024-09-13T18:05:42.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51e4155720 con 0x7f51d0003a20 2024-09-13T18:05:42.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51da7fc700 1 -- 172.21.15.88:0/1025720412 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51e4155720 con 0x7f51d0003a20 2024-09-13T18:05:42.632 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:05:42.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 msgr2=0x7f51c8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 0x7f51c8068bf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f51e40b3c90 tx=0x7f51d4009240 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 msgr2=0x7f51e414ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.628+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f51e000c910 tx=0x7f51e0001a00 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 shutdown_connections 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f51c8066730 0x7f51c8068bf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e40c8860 0x7f51e4153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e4154270 0x7f51e41f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 --2- 172.21.15.88:0/1025720412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51d0003a20 0x7f51e414ff90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 >> 172.21.15.88:0/1025720412 conn(0x7f51e4071790 msgr2=0x7f51e415c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 shutdown_connections 2024-09-13T18:05:42.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.632+0000 7f51ebcc0700 1 -- 172.21.15.88:0/1025720412 wait complete. 2024-09-13T18:05:42.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:05:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 Processor -- start 2024-09-13T18:05:42.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 -- start start 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc00c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdc00c7d20 0x7fbdc01565f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00c2760 con 0x7fbdc00c6780 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00c29b0 con 0x7fbdc00c7d20 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdc4e75700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00c2c90 con 0x7fbdc00c63a0 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdb6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdc00c7d20 0x7fbdc01565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdb6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbdc00c7d20 0x7fbdc01565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50780/0 (socket says 172.21.15.88:50780) 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1592204479 learned_addr learned my addr 172.21.15.88:0/1592204479 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1592204479 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 msgr2=0x7fbdc00c1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdbf7fe700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc00c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.760+0000 7fbdb6ffd700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc00c1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1592204479 >> v1:172.21.15.94:6789/0 conn(0x7fbdc00c6780 legacy=0x7fbdc00c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1592204479 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00c2f70 con 0x7fbdc00c7d20 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdbf7fe700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc00c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdb6ffd700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01565f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009910 tx=0x7fbda8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf6f594ff0efde7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdbeffd700 1 -- 172.21.15.88:0/1592204479 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800ba60 con 0x7fbdc00c7d20 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdbeffd700 1 -- 172.21.15.88:0/1592204479 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda800bbc0 con 0x7fbdc00c7d20 2024-09-13T18:05:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdbeffd700 1 -- 172.21.15.88:0/1592204479 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8009e60 con 0x7fbdc00c7d20 2024-09-13T18:05:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1592204479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c7d20 msgr2=0x7fbdc01565f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01565f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009910 tx=0x7fbda8009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1592204479 shutdown_connections 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01565f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 --2- 172.21.15.88:0/1592204479 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc00c1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1592204479 >> 172.21.15.88:0/1592204479 conn(0x7fbdc00c7120 msgr2=0x7fbdc00c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1592204479 shutdown_connections 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1592204479 wait complete. 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 Processor -- start 2024-09-13T18:05:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.764+0000 7fbdc4e75700 1 -- start start 2024-09-13T18:05:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01f2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0151a70 con 0x7fbdc00c6780 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc01533e0 con 0x7fbdc00c7d20 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc01557a0 con 0x7fbdc00c63a0 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50786/0 (socket says 172.21.15.88:50786) 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1812388951 learned_addr learned my addr 172.21.15.88:0/1812388951 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdbf7fe700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdbffff700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01f2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 msgr2=0x7fbdc01539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc01539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc00c7d20 msgr2=0x7fbdc01f2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01f2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 -- 172.21.15.88:0/1812388951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8009570 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb6ffd700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00c7000 tx=0x7fbda8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8004300 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda801f070 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1812388951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc0153120 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80036c0 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdc4e75700 1 -- 172.21.15.88:0/1812388951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc0154cc0 con 0x7fbdc00c6780 2024-09-13T18:05:42.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.768+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd98005310 con 0x7fbdc00c6780 2024-09-13T18:05:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.772+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbda8021030 con 0x7fbdc00c6780 2024-09-13T18:05:42.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.772+0000 7fbdbcff9700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 0x7fbda0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.772+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda8085560 con 0x7fbdc00c6780 2024-09-13T18:05:42.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.772+0000 7fbdbf7fe700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 0x7fbda0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:42.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.772+0000 7fbdbf7fe700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 0x7fbda0068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000ab60 tx=0x7fbdb0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:42.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.776+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbda8052960 con 0x7fbdc00c6780 2024-09-13T18:05:42.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.944+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd98005b40 con 0x7fbdc00c6780 2024-09-13T18:05:42.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.944+0000 7fbdbcff9700 1 -- 172.21.15.88:0/1812388951 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbda8055f80 con 0x7fbdc00c6780 2024-09-13T18:05:42.950 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:05:42.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 msgr2=0x7fbda0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 0x7fbda0068bf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000ab60 tx=0x7fbdb0008040 comp rx=0 tx=0).stop 2024-09-13T18:05:42.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 msgr2=0x7fbdc01f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:42.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00c7000 tx=0x7fbda8004770 comp rx=0 tx=0).stop 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 shutdown_connections 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbda0066730 0x7fbda0068bf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc00c7d20 0x7fbdc01f2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbdc00c6780 0x7fbdc01f1c40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 --2- 172.21.15.88:0/1812388951 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc00c63a0 0x7fbdc01539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 >> 172.21.15.88:0/1812388951 conn(0x7fbdc00c7120 msgr2=0x7fbdc014f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 shutdown_connections 2024-09-13T18:05:42.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:42.948+0000 7fbdb5ffb700 1 -- 172.21.15.88:0/1812388951 wait complete. 2024-09-13T18:05:42.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:43.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.068+0000 7f976ffff700 1 Processor -- start 2024-09-13T18:05:43.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.068+0000 7f976ffff700 1 -- start start 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f97700c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700c7a50 con 0x7f97700c27a0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97700c6a20 con 0x7f97700c4eb0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97701512b0 con 0x7f9770150ed0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f97700c27a0 0x7f97700c6f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45868/0 (socket says 172.21.15.88:45868) 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 -- 172.21.15.88:0/406442490 learned_addr learned my addr 172.21.15.88:0/406442490 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313543174 0 0) 0x7f97700c7a50 con 0x7f97700c27a0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97580035d0 con 0x7f97700c27a0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976effd700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f97700c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2338259816 0 0) 0x7f97580035d0 con 0x7f97700c27a0 2024-09-13T18:05:43.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 msgr2=0x7f97700c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f97700c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 >> v1:172.21.15.94:6789/0 conn(0x7f97700c4eb0 legacy=0x7f9770161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97700c7cb0 con 0x7f97700c27a0 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f97680019f0 con 0x7f97700c27a0 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 >> v1:172.21.15.88:6789/0 conn(0x7f97700c27a0 legacy=0x7f97700c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9758003a50 0x7f9758003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f9758004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9758004db0 0x7f9758005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97701512b0 con 0x7f9758004db0 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975800ba30 con 0x7f9758003a50 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975800bbf0 con 0x7f9770150ed0 2024-09-13T18:05:43.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f9758004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976effd700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9758003a50 0x7f9758003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976f7fe700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9758004db0 0x7f9758005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 -- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9758003a50 msgr2=0x7f9758003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9758003a50 0x7f9758003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 -- 172.21.15.88:0/406442490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9758004db0 msgr2=0x7f9758005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9758004db0 0x7f9758005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 -- 172.21.15.88:0/406442490 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97580035d0 con 0x7f9770150ed0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976e7fc700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f9758004870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f976800a840 tx=0x7f97580058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39283693998dff10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97680072d0 con 0x7f9770150ed0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768007450 con 0x7f9770150ed0 2024-09-13T18:05:43.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.072+0000 7f976dffb700 1 -- 172.21.15.88:0/406442490 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768007800 con 0x7f9770150ed0 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 msgr2=0x7f9758004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 --2- 172.21.15.88:0/406442490 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f9758004870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f976800a840 tx=0x7f97580058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976f7fe700 1 -- 172.21.15.88:0/406442490 reap_dead start 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- 172.21.15.88:0/406442490 shutdown_connections 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- 172.21.15.88:0/406442490 >> 172.21.15.88:0/406442490 conn(0x7f977006aa30 msgr2=0x7f97700cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- 172.21.15.88:0/406442490 shutdown_connections 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- 172.21.15.88:0/406442490 wait complete. 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 Processor -- start 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- start start 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f977014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 0x7f977014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977014df70 con 0x7f9770143480 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f977014b620 con 0x7f977014c530 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977014b130 con 0x7f9770150ed0 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50814/0 (socket says 172.21.15.88:50814) 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 -- 172.21.15.88:0/2784610893 learned_addr learned my addr 172.21.15.88:0/2784610893 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976effd700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f977014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976f7fe700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 0x7f977014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 -- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 msgr2=0x7f977014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f977014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 -- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 msgr2=0x7f977014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 0x7f977014c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 -- 172.21.15.88:0/2784610893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770141eb0 con 0x7f9770143480 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976effd700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f977014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976f7fe700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 0x7f977014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:43.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.076+0000 7f976e7fc700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f975800bd80 tx=0x7f9770070cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976800ae40 con 0x7f9770143480 2024-09-13T18:05:43.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976800a280 con 0x7f9770143480 2024-09-13T18:05:43.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f977014bd70 con 0x7f9770143480 2024-09-13T18:05:43.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768012640 con 0x7f9770143480 2024-09-13T18:05:43.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9770157d30 con 0x7f9770143480 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f976801a070 con 0x7f9770143480 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97700ca560 con 0x7f9770143480 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 0x7f975c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9768085e20 con 0x7f9770143480 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f976effd700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 0x7f975c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.080+0000 7f976effd700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 0x7f975c068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9764009bf0 tx=0x7f9764008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.088+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9768053340 con 0x7f9770143480 2024-09-13T18:05:43.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.296+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9770151550 con 0x7f9770143480 2024-09-13T18:05:43.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.296+0000 7f97577fe700 1 -- 172.21.15.88:0/2784610893 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+6268 (secure 0 0 0) 0x7f9768056960 con 0x7f9770143480 2024-09-13T18:05:43.302 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:43.302 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:37.537416+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:05:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 msgr2=0x7f975c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 0x7f975c068bf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9764009bf0 tx=0x7f9764008040 comp rx=0 tx=0).stop 2024-09-13T18:05:43.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 msgr2=0x7f9770146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f975800bd80 tx=0x7f9770070cf0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 shutdown_connections 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f975c066730 0x7f975c068bf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f977014c530 0x7f977014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9770143480 0x7f9770146820 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 --2- 172.21.15.88:0/2784610893 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9770150ed0 0x7f977014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 >> 172.21.15.88:0/2784610893 conn(0x7f977006aa30 msgr2=0x7f97700c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 shutdown_connections 2024-09-13T18:05:43.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.300+0000 7f976ffff700 1 -- 172.21.15.88:0/2784610893 wait complete. 2024-09-13T18:05:43.306 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 11 2024-09-13T18:05:43.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:43.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 Processor -- start 2024-09-13T18:05:43.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- start start 2024-09-13T18:05:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c014f6d0 0x7ff9c006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.432 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9c0155f60 0x7ff9c006eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c00c2750 con 0x7ff9c006f3e0 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c006c090 con 0x7ff9c0155f60 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c00c2980 con 0x7ff9c014f6d0 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9c0155f60 0x7ff9c006eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff9c006f3e0 0x7ff9c00c3740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45872/0 (socket says 172.21.15.88:45872) 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bed9d700 1 -- 172.21.15.88:0/2444104518 learned_addr learned my addr 172.21.15.88:0/2444104518 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9be59c700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c014f6d0 0x7ff9c006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 -- 172.21.15.88:0/2444104518 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c014f6d0 msgr2=0x7ff9c006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c014f6d0 0x7ff9c006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 -- 172.21.15.88:0/2444104518 >> v1:172.21.15.88:6789/0 conn(0x7ff9c006f3e0 legacy=0x7ff9c00c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 -- 172.21.15.88:0/2444104518 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c00c2c60 con 0x7ff9c0155f60 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bdd9b700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c0155f60 0x7ff9c006eea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009d90 tx=0x7ff9a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ce7c2055393a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bd59a700 1 -- 172.21.15.88:0/2444104518 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800e070 con 0x7ff9c0155f60 2024-09-13T18:05:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bd59a700 1 -- 172.21.15.88:0/2444104518 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800bbd0 con 0x7ff9c0155f60 2024-09-13T18:05:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9bd59a700 1 -- 172.21.15.88:0/2444104518 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8012430 con 0x7ff9c0155f60 2024-09-13T18:05:43.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2444104518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c0155f60 msgr2=0x7ff9c006eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c0155f60 0x7ff9c006eea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009d90 tx=0x7ff9a800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2444104518 shutdown_connections 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c0155f60 0x7ff9c006eea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2444104518 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c014f6d0 0x7ff9c006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2444104518 >> 172.21.15.88:0/2444104518 conn(0x7ff9c00ca790 msgr2=0x7ff9c00caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2444104518 shutdown_connections 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.428+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2444104518 wait complete. 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 Processor -- start 2024-09-13T18:05:43.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- start start 2024-09-13T18:05:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.437 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9c014f6d0 0x7ff9c01f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 0x7ff9c01f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0151060 con 0x7ff9c006f3e0 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c01f0490 con 0x7ff9c014f6d0 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c0150dc0 con 0x7ff9c0155f60 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50832/0 (socket says 172.21.15.88:50832) 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 -- 172.21.15.88:0/2675062757 learned_addr learned my addr 172.21.15.88:0/2675062757 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9bdd9b700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9c014f6d0 0x7ff9c01f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9bed9d700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 0x7ff9c01f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 -- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 msgr2=0x7ff9c01f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 0x7ff9c01f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 -- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9c014f6d0 msgr2=0x7ff9c01f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.438 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9c014f6d0 0x7ff9c01f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 -- 172.21.15.88:0/2675062757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a8009a70 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9bed9d700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 0x7ff9c01f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9be59c700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e760 tx=0x7ff9b000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0013610 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b0013770 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c01f00b0 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b0013ae0 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.432+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c0151d30 con 0x7ff9c006f3e0 2024-09-13T18:05:43.439 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.436+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c01f0700 con 0x7ff9c006f3e0 2024-09-13T18:05:43.440 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.436+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9b0013c40 con 0x7ff9c006f3e0 2024-09-13T18:05:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.436+0000 7ff9b6ffd700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 0x7ff9a0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.436+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9b0084180 con 0x7ff9c006f3e0 2024-09-13T18:05:43.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.436+0000 7ff9bdd9b700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 0x7ff9a0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.440+0000 7ff9bdd9b700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 0x7ff9a0068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009d90 tx=0x7ff9a8011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.444+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff9b0051660 con 0x7ff9c006f3e0 2024-09-13T18:05:43.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.616+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c01eff10 con 0x7ff9c006f3e0 2024-09-13T18:05:43.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9b6ffd700 1 -- 172.21.15.88:0/2675062757 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7ff9c01eff10 con 0x7ff9c006f3e0 2024-09-13T18:05:43.624 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:43.624 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 msgr2=0x7ff9a0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 0x7ff9a0068bf0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8009d90 tx=0x7ff9a8011000 comp rx=0 tx=0).stop 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 msgr2=0x7ff9c01458a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff9b000e760 tx=0x7ff9b000eb20 comp rx=0 tx=0).stop 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 shutdown_connections 2024-09-13T18:05:43.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff9a0066730 0x7ff9a0068bf0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff9c0155f60 0x7ff9c01f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9c014f6d0 0x7ff9c01f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 --2- 172.21.15.88:0/2675062757 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9c006f3e0 0x7ff9c01458a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 >> 172.21.15.88:0/2675062757 conn(0x7ff9c00ca790 msgr2=0x7ff9c00c9a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 shutdown_connections 2024-09-13T18:05:43.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.620+0000 7ff9c4fa1700 1 -- 172.21.15.88:0/2675062757 wait complete. 2024-09-13T18:05:43.639 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:43.639 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:43.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 Processor -- start 2024-09-13T18:05:43.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 -- start start 2024-09-13T18:05:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1720156cb0 0x7f17200c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17200c9240 0x7f17200c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f172006e6f0 con 0x7f1720150c10 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200c4180 con 0x7f17200c9240 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171ffff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17200c4ae0 con 0x7f1720156cb0 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17200c9240 0x7f17200c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1720150c10 0x7f172006dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45884/0 (socket says 172.21.15.88:45884) 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171effd700 1 -- 172.21.15.88:0/1831005426 learned_addr learned my addr 172.21.15.88:0/1831005426 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171e7fc700 1 --2- 172.21.15.88:0/1831005426 >> v2:172.21.15.94:3300/0 conn(0x7f1720156cb0 0x7f17200c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 -- 172.21.15.88:0/1831005426 >> v2:172.21.15.94:3300/0 conn(0x7f1720156cb0 msgr2=0x7f17200c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 --2- 172.21.15.88:0/1831005426 >> v2:172.21.15.94:3300/0 conn(0x7f1720156cb0 0x7f17200c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 -- 172.21.15.88:0/1831005426 >> v1:172.21.15.88:6789/0 conn(0x7f1720150c10 legacy=0x7f172006dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 -- 172.21.15.88:0/1831005426 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17200c6cb0 con 0x7f17200c9240 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171dffb700 1 -- 172.21.15.88:0/1831005426 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3296161681 0 0) 0x7f172006e6f0 con 0x7f1720150c10 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171f7fe700 1 --2- 172.21.15.88:0/1831005426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17200c9240 0x7f17200c9670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1720157e20 tx=0x7f171800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9be272a9f057136 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171dffb700 1 -- 172.21.15.88:0/1831005426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171800e070 con 0x7f17200c9240 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171dffb700 1 -- 172.21.15.88:0/1831005426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171800bb20 con 0x7f17200c9240 2024-09-13T18:05:43.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.752+0000 7f171dffb700 1 -- 172.21.15.88:0/1831005426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012430 con 0x7f17200c9240 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- 172.21.15.88:0/1831005426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17200c9240 msgr2=0x7f17200c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- 172.21.15.88:0/1831005426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17200c9240 0x7f17200c9670 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1720157e20 tx=0x7f171800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- 172.21.15.88:0/1831005426 shutdown_connections 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- 172.21.15.88:0/1831005426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17200c9240 0x7f17200c9670 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- 172.21.15.88:0/1831005426 >> v2:172.21.15.94:3300/0 conn(0x7f1720156cb0 0x7f17200c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- 172.21.15.88:0/1831005426 >> 172.21.15.88:0/1831005426 conn(0x7f1720066090 msgr2=0x7f17200664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- 172.21.15.88:0/1831005426 shutdown_connections 2024-09-13T18:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- 172.21.15.88:0/1831005426 wait complete. 2024-09-13T18:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 Processor -- start 2024-09-13T18:05:43.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- start start 2024-09-13T18:05:43.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 0x7f17201433f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1720150c10 0x7f1720146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 0x7f17201469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17201517c0 con 0x7f1720156cb0 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17200c4880 con 0x7f17200c9240 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.756+0000 7f171ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17201450f0 con 0x7f1720150c10 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 0x7f17201433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 0x7f17201469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171effd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 0x7f17201433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:43876/0 (socket says 172.21.15.88:43876) 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171effd700 1 -- 172.21.15.88:0/3407558563 learned_addr learned my addr 172.21.15.88:0/3407558563 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171e7fc700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1720150c10 0x7f1720146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 -- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1720150c10 msgr2=0x7f1720146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1720150c10 0x7f1720146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 -- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 msgr2=0x7f17201433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 0x7f17201433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 -- 172.21.15.88:0/3407558563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009a70 con 0x7f1720156cb0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171f7fe700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 0x7f17201469c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1718016000 tx=0x7f1718004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718012430 con 0x7f1720156cb0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718020070 con 0x7f1720156cb0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17201453d0 con 0x7f1720156cb0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718004280 con 0x7f1720156cb0 2024-09-13T18:05:43.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1720145990 con 0x7f1720156cb0 2024-09-13T18:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17201ec570 con 0x7f1720156cb0 2024-09-13T18:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.760+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f17180043e0 con 0x7f1720156cb0 2024-09-13T18:05:43.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.764+0000 7f17077fe700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.764+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1718022070 con 0x7f1720156cb0 2024-09-13T18:05:43.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.764+0000 7f171effd700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:43.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.764+0000 7f171effd700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1714000f60 tx=0x7f1714007ec0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:43.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.768+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1718053490 con 0x7f1720156cb0 2024-09-13T18:05:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.944+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17200c69d0 con 0x7f1720156cb0 2024-09-13T18:05:43.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.944+0000 7f17077fe700 1 -- 172.21.15.88:0/3407558563 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1718056ab0 con 0x7f1720156cb0 2024-09-13T18:05:43.949 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 msgr2=0x7f170c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 0x7f170c068bf0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1714000f60 tx=0x7f1714007ec0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 msgr2=0x7f17201469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 0x7f17201469c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1718016000 tx=0x7f1718004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 shutdown_connections 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f170c066730 0x7f170c068bf0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1720150c10 0x7f1720146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1720156cb0 0x7f17201469c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 --2- 172.21.15.88:0/3407558563 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f17200c9240 0x7f17201433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 >> 172.21.15.88:0/3407558563 conn(0x7f1720066090 msgr2=0x7f1720066470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 shutdown_connections 2024-09-13T18:05:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:43.948+0000 7f171ffff700 1 -- 172.21.15.88:0/3407558563 wait complete. 2024-09-13T18:05:43.967 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:05:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 Processor -- start 2024-09-13T18:05:44.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 -- start start 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 0x7f2e3c049090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e3c007480 0x7f2e3c04efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e3c054df0 con 0x7f2e3c0e1c00 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e3c050a10 con 0x7f2e3c007480 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4abf5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c006ff0 con 0x7f2e3c0d8920 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e493f2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e3c007480 0x7f2e3c04efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4a3f4700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f2e3c0e1c00 0x7f2e3c0e2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45900/0 (socket says 172.21.15.88:45900) 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e493f2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e3c007480 0x7f2e3c04efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50856/0 (socket says 172.21.15.88:50856) 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.088+0000 7f2e4a3f4700 1 -- 172.21.15.88:0/712308577 learned_addr learned my addr 172.21.15.88:0/712308577 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e49bf3700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 0x7f2e3c049090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e493f2700 1 -- 172.21.15.88:0/712308577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 msgr2=0x7f2e3c049090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e493f2700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 0x7f2e3c049090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e493f2700 1 -- 172.21.15.88:0/712308577 >> v1:172.21.15.88:6789/0 conn(0x7f2e3c0e1c00 legacy=0x7f2e3c0e2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e493f2700 1 -- 172.21.15.88:0/712308577 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3c0495d0 con 0x7f2e3c007480 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e48bf1700 1 -- 172.21.15.88:0/712308577 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186570823 0 0) 0x7f2e3c054df0 con 0x7f2e3c0e1c00 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e49bf3700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 0x7f2e3c049090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e493f2700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c007480 0x7f2e3c04efb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009840 tx=0x7f2e34009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109751f03aabd20b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e48bf1700 1 -- 172.21.15.88:0/712308577 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34005e50 con 0x7f2e3c007480 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e48bf1700 1 -- 172.21.15.88:0/712308577 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34006030 con 0x7f2e3c007480 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e48bf1700 1 -- 172.21.15.88:0/712308577 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340063c0 con 0x7f2e3c007480 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- 172.21.15.88:0/712308577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c007480 msgr2=0x7f2e3c04efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c007480 0x7f2e3c04efb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009840 tx=0x7f2e34009b50 comp rx=0 tx=0).stop 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- 172.21.15.88:0/712308577 shutdown_connections 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c007480 0x7f2e3c04efb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/712308577 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0d8920 0x7f2e3c049090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- 172.21.15.88:0/712308577 >> 172.21.15.88:0/712308577 conn(0x7f2e3c054110 msgr2=0x7f2e3c054520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- 172.21.15.88:0/712308577 shutdown_connections 2024-09-13T18:05:44.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- 172.21.15.88:0/712308577 wait complete. 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 Processor -- start 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.092+0000 7f2e4abf5700 1 -- start start 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e3c007480 0x7f2e3c0399a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0e1c00 0x7f2e3c04d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c177fc0 con 0x7f2e3c0d8920 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0d8f40 con 0x7f2e3c007480 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3c0d9200 con 0x7f2e3c0e1c00 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50862/0 (socket says 172.21.15.88:50862) 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 -- 172.21.15.88:0/3301031348 learned_addr learned my addr 172.21.15.88:0/3301031348 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:44.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e49bf3700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e3c007480 0x7f2e3c0399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4a3f4700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0e1c00 0x7f2e3c04d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 -- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0e1c00 msgr2=0x7f2e3c04d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0e1c00 0x7f2e3c04d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 -- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e3c007480 msgr2=0x7f2e3c0399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e3c007480 0x7f2e3c0399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 -- 172.21.15.88:0/3301031348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e34009450 con 0x7f2e3c0d8920 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e493f2700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e340038c0 con 0x7f2e3c0d8920 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e34020070 con 0x7f2e3c0d8920 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e34003c60 con 0x7f2e3c0d8920 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3c0d94e0 con 0x7f2e3c0d8920 2024-09-13T18:05:44.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e3c177970 con 0x7f2e3c0d8920 2024-09-13T18:05:44.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.096+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e3c050730 con 0x7f2e3c0d8920 2024-09-13T18:05:44.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.100+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e34022030 con 0x7f2e3c0d8920 2024-09-13T18:05:44.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.100+0000 7f2e3a7fc700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 0x7f2e28068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.100+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e34085770 con 0x7f2e3c0d8920 2024-09-13T18:05:44.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.100+0000 7f2e49bf3700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 0x7f2e28068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.100+0000 7f2e49bf3700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 0x7f2e28068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006fd0 tx=0x7f2e40008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.113 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.108+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e34052af0 con 0x7f2e3c0d8920 2024-09-13T18:05:44.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e3c04fb60 con 0x7f2e3c0d8920 2024-09-13T18:05:44.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e3a7fc700 1 -- 172.21.15.88:0/3301031348 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e34056110 con 0x7f2e3c0d8920 2024-09-13T18:05:44.283 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:05:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 msgr2=0x7f2e28068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 0x7f2e28068bf0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2e40006fd0 tx=0x7f2e40008040 comp rx=0 tx=0).stop 2024-09-13T18:05:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 msgr2=0x7f2e3c174080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e34000c00 tx=0x7f2e34004770 comp rx=0 tx=0).stop 2024-09-13T18:05:44.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 shutdown_connections 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e28066730 0x7f2e28068bf0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e3c0e1c00 0x7f2e3c04d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e3c0d8920 0x7f2e3c174080 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 --2- 172.21.15.88:0/3301031348 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e3c007480 0x7f2e3c0399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 >> 172.21.15.88:0/3301031348 conn(0x7f2e3c054110 msgr2=0x7f2e3c004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 shutdown_connections 2024-09-13T18:05:44.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.280+0000 7f2e4abf5700 1 -- 172.21.15.88:0/3301031348 wait complete. 2024-09-13T18:05:44.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:05:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.412+0000 7f70beaac700 1 Processor -- start 2024-09-13T18:05:44.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.412+0000 7f70beaac700 1 -- start start 2024-09-13T18:05:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70b80c63a0 0x7f70b80c1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80c2760 con 0x7f70b80c7d20 2024-09-13T18:05:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b80c29b0 con 0x7f70b80c6780 2024-09-13T18:05:44.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b80c2c90 con 0x7f70b80c63a0 2024-09-13T18:05:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bdaaa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f70b80c63a0 0x7f70b80c1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bd2a9700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f70b80c7d20 0x7f70b80c3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45904/0 (socket says 172.21.15.88:45904) 2024-09-13T18:05:44.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bd2a9700 1 -- 172.21.15.88:0/1863233467 learned_addr learned my addr 172.21.15.88:0/1863233467 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bcaa8700 1 -- 172.21.15.88:0/1863233467 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777293912 0 0) 0x7f70b80c29b0 con 0x7f70b80c6780 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bdaaa700 1 -- 172.21.15.88:0/1863233467 >> v1:172.21.15.94:6789/0 conn(0x7f70b80c6780 legacy=0x7f70b814f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bdaaa700 1 -- 172.21.15.88:0/1863233467 >> v1:172.21.15.88:6789/0 conn(0x7f70b80c7d20 legacy=0x7f70b80c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bdaaa700 1 -- 172.21.15.88:0/1863233467 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b80c2f70 con 0x7f70b80c63a0 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bdaaa700 1 --2- 172.21.15.88:0/1863233467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c63a0 0x7f70b80c1b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2a84ba903829c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bcaa8700 1 -- 172.21.15.88:0/1863233467 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0004230 con 0x7f70b80c63a0 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bcaa8700 1 -- 172.21.15.88:0/1863233467 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0004390 con 0x7f70b80c63a0 2024-09-13T18:05:44.421 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70bcaa8700 1 -- 172.21.15.88:0/1863233467 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b00036c0 con 0x7f70b80c63a0 2024-09-13T18:05:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- 172.21.15.88:0/1863233467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c63a0 msgr2=0x7f70b80c1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 --2- 172.21.15.88:0/1863233467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c63a0 0x7f70b80c1b20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:44.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- 172.21.15.88:0/1863233467 shutdown_connections 2024-09-13T18:05:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 --2- 172.21.15.88:0/1863233467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c63a0 0x7f70b80c1b20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- 172.21.15.88:0/1863233467 >> 172.21.15.88:0/1863233467 conn(0x7f70b80c7120 msgr2=0x7f70b80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- 172.21.15.88:0/1863233467 shutdown_connections 2024-09-13T18:05:44.423 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.416+0000 7f70beaac700 1 -- 172.21.15.88:0/1863233467 wait complete. 2024-09-13T18:05:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 Processor -- start 2024-09-13T18:05:44.424 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 -- start start 2024-09-13T18:05:44.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70b80c63a0 0x7f70b813f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.426 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b80c7d20 0x7f70b8141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b813d9d0 con 0x7f70b80c6780 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81ed730 con 0x7f70b80c7d20 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b81ec8c0 con 0x7f70b80c63a0 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50890/0 (socket says 172.21.15.88:50890) 2024-09-13T18:05:44.427 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 -- 172.21.15.88:0/1881151885 learned_addr learned my addr 172.21.15.88:0/1881151885 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bdaaa700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70b80c63a0 0x7f70b813f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70be2ab700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b80c7d20 0x7f70b8141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 -- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70b80c63a0 msgr2=0x7f70b813f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70b80c63a0 0x7f70b813f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 -- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b80c7d20 msgr2=0x7f70b8141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b80c7d20 0x7f70b8141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 -- 172.21.15.88:0/1881151885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00094b0 con 0x7f70b80c6780 2024-09-13T18:05:44.428 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70bd2a9700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c7b0 tx=0x7f70ac00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac004ca0 con 0x7f70b80c6780 2024-09-13T18:05:44.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ac004e00 con 0x7f70b80c6780 2024-09-13T18:05:44.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.420+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b8149d30 con 0x7f70b80c6780 2024-09-13T18:05:44.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ac007310 con 0x7f70b80c6780 2024-09-13T18:05:44.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b81ecab0 con 0x7f70b80c6780 2024-09-13T18:05:44.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b81ed870 con 0x7f70b80c6780 2024-09-13T18:05:44.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f70ac007470 con 0x7f70b80c6780 2024-09-13T18:05:44.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70b67fc700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 0x7f70a4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70ac083e70 con 0x7f70b80c6780 2024-09-13T18:05:44.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.424+0000 7f70bdaaa700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 0x7f70a4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.431 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.428+0000 7f70bdaaa700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 0x7f70a4068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.432+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f70ac051270 con 0x7f70b80c6780 2024-09-13T18:05:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.600+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70b80c1b20 con 0x7f70b80c6780 2024-09-13T18:05:44.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.600+0000 7f70b67fc700 1 -- 172.21.15.88:0/1881151885 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70ac054890 con 0x7f70b80c6780 2024-09-13T18:05:44.605 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 msgr2=0x7f70a4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 0x7f70a4068bf0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0010000 comp rx=0 tx=0).stop 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 msgr2=0x7f70b8141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f70ac00c7b0 tx=0x7f70ac00cac0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 shutdown_connections 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f70a4066730 0x7f70a4068bf0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70b80c7d20 0x7f70b8141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f70b80c6780 0x7f70b8141720 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 --2- 172.21.15.88:0/1881151885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70b80c63a0 0x7f70b813f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 >> 172.21.15.88:0/1881151885 conn(0x7f70b80c7120 msgr2=0x7f70b80c7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 shutdown_connections 2024-09-13T18:05:44.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.604+0000 7f70beaac700 1 -- 172.21.15.88:0/1881151885 wait complete. 2024-09-13T18:05:44.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:44.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.720+0000 7faf01966700 1 Processor -- start 2024-09-13T18:05:44.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.720+0000 7faf01966700 1 -- start start 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 0x7faefc070b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0ca950 0x7faefc0c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faefc0710c0 con 0x7faefc0cbf10 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc159f90 con 0x7faefc0ca950 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faefc0c4440 con 0x7faefc0ca570 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0ca950 0x7faefc0c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faefc0ca950 0x7faefc0c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50904/0 (socket says 172.21.15.88:50904) 2024-09-13T18:05:44.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 -- 172.21.15.88:0/4097784247 learned_addr learned my addr 172.21.15.88:0/4097784247 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf00964700 1 --2- 172.21.15.88:0/4097784247 >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 0x7faefc070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 -- 172.21.15.88:0/4097784247 >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 msgr2=0x7faefc070b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 --2- 172.21.15.88:0/4097784247 >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 0x7faefc070b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 -- 172.21.15.88:0/4097784247 >> v1:172.21.15.94:6789/0 conn(0x7faefc0cbf10 legacy=0x7faefc152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 -- 172.21.15.88:0/4097784247 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faefc0c47f0 con 0x7faefc0ca950 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf00964700 1 --2- 172.21.15.88:0/4097784247 >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 0x7faefc070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefbfff700 1 --2- 172.21.15.88:0/4097784247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca950 0x7faefc0c4c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faefc071350 tx=0x7faeec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752e3a99875b3d50 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefb7fe700 1 -- 172.21.15.88:0/4097784247 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec004230 con 0x7faefc0ca950 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefb7fe700 1 -- 172.21.15.88:0/4097784247 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec004390 con 0x7faefc0ca950 2024-09-13T18:05:44.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faefb7fe700 1 -- 172.21.15.88:0/4097784247 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec0036c0 con 0x7faefc0ca950 2024-09-13T18:05:44.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- 172.21.15.88:0/4097784247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca950 msgr2=0x7faefc0c4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 --2- 172.21.15.88:0/4097784247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca950 0x7faefc0c4c80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faefc071350 tx=0x7faeec009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- 172.21.15.88:0/4097784247 shutdown_connections 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 --2- 172.21.15.88:0/4097784247 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca950 0x7faefc0c4c80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 --2- 172.21.15.88:0/4097784247 >> v2:172.21.15.94:3300/0 conn(0x7faefc0ca570 0x7faefc070b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- 172.21.15.88:0/4097784247 >> 172.21.15.88:0/4097784247 conn(0x7faefc0cb3f0 msgr2=0x7faefc0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- 172.21.15.88:0/4097784247 shutdown_connections 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.724+0000 7faf01966700 1 -- 172.21.15.88:0/4097784247 wait complete. 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 Processor -- start 2024-09-13T18:05:44.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- start start 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faefc0ca950 0x7faefc06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faefc0cbf10 0x7faefc070060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc0cc950 con 0x7faefc0ca570 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc06f700 con 0x7faefc0cbf10 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faefc06f3e0 con 0x7faefc0ca950 2024-09-13T18:05:44.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50908/0 (socket says 172.21.15.88:50908) 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 -- 172.21.15.88:0/419455196 learned_addr learned my addr 172.21.15.88:0/419455196 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faefbfff700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faefc0ca950 0x7faefc06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01165700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faefc0cbf10 0x7faefc070060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 -- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faefc0ca950 msgr2=0x7faefc06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faefc0ca950 0x7faefc06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 -- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faefc0cbf10 msgr2=0x7faefc070060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faefc0cbf10 0x7faefc070060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 -- 172.21.15.88:0/419455196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec009570 con 0x7faefc0ca570 2024-09-13T18:05:44.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf00964700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faef000c7a0 tx=0x7faef000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0011800 con 0x7faefc0ca570 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef0011960 con 0x7faefc0ca570 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc1ef050 con 0x7faefc0ca570 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef0011d10 con 0x7faefc0ca570 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.728+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc1ef2a0 con 0x7faefc0ca570 2024-09-13T18:05:44.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.732+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faefc158fd0 con 0x7faefc0ca570 2024-09-13T18:05:44.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.732+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faef0018360 con 0x7faefc0ca570 2024-09-13T18:05:44.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.732+0000 7faef97fa700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 0x7faee8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:44.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.732+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faef00840a0 con 0x7faefc0ca570 2024-09-13T18:05:44.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.732+0000 7faefbfff700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 0x7faee8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:44.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.736+0000 7faefbfff700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 0x7faee8068c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc071350 tx=0x7faeec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:44.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.740+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7faef0051410 con 0x7faefc0ca570 2024-09-13T18:05:44.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.944+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faefc0c5370 con 0x7faefc0ca570 2024-09-13T18:05:44.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faef97fa700 1 -- 172.21.15.88:0/419455196 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7faef0054a30 con 0x7faefc0ca570 2024-09-13T18:05:44.951 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:05:44.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 msgr2=0x7faee8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 0x7faee8068c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc071350 tx=0x7faeec008030 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 msgr2=0x7faefc06eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7faef000c7a0 tx=0x7faef000cab0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 shutdown_connections 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faee8066760 0x7faee8068c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faefc0ca950 0x7faefc06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faefc0cbf10 0x7faefc070060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 --2- 172.21.15.88:0/419455196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faefc0ca570 0x7faefc06eea0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 >> 172.21.15.88:0/419455196 conn(0x7faefc0cb3f0 msgr2=0x7faefc1507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 shutdown_connections 2024-09-13T18:05:44.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:44.948+0000 7faf01966700 1 -- 172.21.15.88:0/419455196 wait complete. 2024-09-13T18:05:44.955 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:05:44.966 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 Processor -- start 2024-09-13T18:05:45.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- start start 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa3e80c9fd0 0x7fa3e8153180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80cc100 0x7fa3e81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e80cc600 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e81592d0 con 0x7fa3e80c9fd0 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80cb450 con 0x7fa3e80cc100 2024-09-13T18:05:45.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50924/0 (socket says 172.21.15.88:50924) 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 -- 172.21.15.88:0/3160778705 learned_addr learned my addr 172.21.15.88:0/3160778705 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e6ffd700 1 --2- 172.21.15.88:0/3160778705 >> v2:172.21.15.94:3300/0 conn(0x7fa3e80c9fd0 0x7fa3e8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e7fff700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80cc100 0x7fa3e81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 -- 172.21.15.88:0/3160778705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80cc100 msgr2=0x7fa3e81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80cc100 0x7fa3e81536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 -- 172.21.15.88:0/3160778705 >> v2:172.21.15.94:3300/0 conn(0x7fa3e80c9fd0 msgr2=0x7fa3e8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/3160778705 >> v2:172.21.15.94:3300/0 conn(0x7fa3e80c9fd0 0x7fa3e8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 -- 172.21.15.88:0/3160778705 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e815a0f0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80b50b0 tx=0x7fa3dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9ce27c614304cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e67fc700 1 -- 172.21.15.88:0/3160778705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011830 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e67fc700 1 -- 172.21.15.88:0/3160778705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc011990 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3e67fc700 1 -- 172.21.15.88:0/3160778705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc011d20 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- 172.21.15.88:0/3160778705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9bf0 msgr2=0x7fa3e80cbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80b50b0 tx=0x7fa3dc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- 172.21.15.88:0/3160778705 shutdown_connections 2024-09-13T18:05:45.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80cc100 0x7fa3e81536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- 172.21.15.88:0/3160778705 >> v2:172.21.15.94:3300/0 conn(0x7fa3e80c9fd0 0x7fa3e8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 --2- 172.21.15.88:0/3160778705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9bf0 0x7fa3e80cbbc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- 172.21.15.88:0/3160778705 >> 172.21.15.88:0/3160778705 conn(0x7fa3e8071c80 msgr2=0x7fa3e8072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- 172.21.15.88:0/3160778705 shutdown_connections 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.072+0000 7fa3edd93700 1 -- 172.21.15.88:0/3160778705 wait complete. 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 Processor -- start 2024-09-13T18:05:45.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 -- start start 2024-09-13T18:05:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 0x7fa3e8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e80cc100 0x7fa3e81eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8148920 con 0x7fa3e80c9fd0 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b45d0 con 0x7fa3e80cc100 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3edd93700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80b48b0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3e6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3e6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50936/0 (socket says 172.21.15.88:50936) 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3e6ffd700 1 -- 172.21.15.88:0/1527850902 learned_addr learned my addr 172.21.15.88:0/1527850902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 0x7fa3e8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.076+0000 7fa3e7fff700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e80cc100 0x7fa3e81eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 -- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e80cc100 msgr2=0x7fa3e81eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e80cc100 0x7fa3e81eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 -- 172.21.15.88:0/1527850902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 msgr2=0x7fa3e815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 -- 172.21.15.88:0/1527850902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009570 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e6ffd700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3e77fe700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 0x7fa3e8151ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8066e00 tx=0x7fa3dc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc004450 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0045b0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc003900 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e80b4b90 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e8148540 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e80c46e0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3dc021070 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.080+0000 7fa3cffff700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 0x7fa3d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.084+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3dc0855a0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.084+0000 7fa3e6ffd700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 0x7fa3d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.084+0000 7fa3e6ffd700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 0x7fa3d4068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80b3fa0 tx=0x7fa3e000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.092+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3dc0529f0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.264+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3e80ca4e0 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.264+0000 7fa3cffff700 1 -- 172.21.15.88:0/1527850902 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fa3dc056010 con 0x7fa3e80c9bf0 2024-09-13T18:05:45.270 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 msgr2=0x7fa3d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 0x7fa3d4068bf0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80b3fa0 tx=0x7fa3e000d040 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 msgr2=0x7fa3e8151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 0x7fa3e8151ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8066e00 tx=0x7fa3dc004770 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 shutdown_connections 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3d4066730 0x7fa3d4068bf0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3e80cc100 0x7fa3e81eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3e80c9fd0 0x7fa3e815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 --2- 172.21.15.88:0/1527850902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3e80c9bf0 0x7fa3e8151ed0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 >> 172.21.15.88:0/1527850902 conn(0x7fa3e8071c80 msgr2=0x7fa3e8158430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 shutdown_connections 2024-09-13T18:05:45.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.268+0000 7fa3edd93700 1 -- 172.21.15.88:0/1527850902 wait complete. 2024-09-13T18:05:45.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 Processor -- start 2024-09-13T18:05:45.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 -- start start 2024-09-13T18:05:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97501613e0 0x7f97500c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97500c1f70 0x7f9750167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97500c1db0 con 0x7f97501574b0 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9750160f50 con 0x7f97500c1f70 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9756c9d700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97500c5b40 con 0x7f97501613e0 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97500c1f70 0x7f9750167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97500c1f70 0x7f9750167ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50942/0 (socket says 172.21.15.88:50942) 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 -- 172.21.15.88:0/3384011305 learned_addr learned my addr 172.21.15.88:0/3384011305 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:45.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975549a700 1 --2- 172.21.15.88:0/3384011305 >> v2:172.21.15.94:3300/0 conn(0x7f97501613e0 0x7f97500c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 -- 172.21.15.88:0/3384011305 >> v2:172.21.15.94:3300/0 conn(0x7f97501613e0 msgr2=0x7f97500c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 --2- 172.21.15.88:0/3384011305 >> v2:172.21.15.94:3300/0 conn(0x7f97501613e0 0x7f97500c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 -- 172.21.15.88:0/3384011305 >> v1:172.21.15.94:6789/0 conn(0x7f97501574b0 legacy=0x7f9750071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 -- 172.21.15.88:0/3384011305 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500c1630 con 0x7f97500c1f70 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f975649c700 1 --2- 172.21.15.88:0/3384011305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97500c1f70 0x7f9750167ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9750072ad0 tx=0x7f974800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9710197ee7b5c235 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9754c99700 1 -- 172.21.15.88:0/3384011305 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800e070 con 0x7f97500c1f70 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9754c99700 1 -- 172.21.15.88:0/3384011305 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974800b910 con 0x7f97500c1f70 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.396+0000 7f9754c99700 1 -- 172.21.15.88:0/3384011305 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974800bcc0 con 0x7f97500c1f70 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 -- 172.21.15.88:0/3384011305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97500c1f70 msgr2=0x7f9750167ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 --2- 172.21.15.88:0/3384011305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97500c1f70 0x7f9750167ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9750072ad0 tx=0x7f974800b330 comp rx=0 tx=0).stop 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 -- 172.21.15.88:0/3384011305 shutdown_connections 2024-09-13T18:05:45.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 --2- 172.21.15.88:0/3384011305 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97500c1f70 0x7f9750167ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 --2- 172.21.15.88:0/3384011305 >> v2:172.21.15.94:3300/0 conn(0x7f97501613e0 0x7f97500c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 -- 172.21.15.88:0/3384011305 >> 172.21.15.88:0/3384011305 conn(0x7f97500ca720 msgr2=0x7f97500cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 -- 172.21.15.88:0/3384011305 shutdown_connections 2024-09-13T18:05:45.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.400+0000 7f9756c9d700 1 -- 172.21.15.88:0/3384011305 wait complete. 2024-09-13T18:05:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 Processor -- start 2024-09-13T18:05:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- start start 2024-09-13T18:05:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 0x7f975006d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 0x7f97500c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9750150920 con 0x7f97501574b0 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97501e6550 con 0x7f97501613e0 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97501e70d0 con 0x7f97500c1f70 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50952/0 (socket says 172.21.15.88:50952) 2024-09-13T18:05:45.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 -- 172.21.15.88:0/770723278 learned_addr learned my addr 172.21.15.88:0/770723278 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9755c9b700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 0x7f975006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975649c700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 0x7f97500c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 -- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 msgr2=0x7f975006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 0x7f975006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 -- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 msgr2=0x7f97500c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 0x7f97500c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 -- 172.21.15.88:0/770723278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748009b30 con 0x7f97501574b0 2024-09-13T18:05:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975649c700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 0x7f97500c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9755c9b700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 0x7f975006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f975549a700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e8a0 tx=0x7f974c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0095a0 con 0x7f97501574b0 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c00eea0 con 0x7f97501574b0 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97501f3a40 con 0x7f97501574b0 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c00ca50 con 0x7f97501574b0 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.404+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97501e6a80 con 0x7f97501574b0 2024-09-13T18:05:45.418 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9750157890 con 0x7f97501574b0 2024-09-13T18:05:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f974c00cbb0 con 0x7f97501574b0 2024-09-13T18:05:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f97467fc700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 0x7f9734068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974c084190 con 0x7f97501574b0 2024-09-13T18:05:45.419 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f9755c9b700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 0x7f9734068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:45.420 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.408+0000 7f9755c9b700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 0x7f9734068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97400017a0 tx=0x7f9740009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:45.422 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.416+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f974c051480 con 0x7f97501574b0 2024-09-13T18:05:45.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.624+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9750154880 con 0x7f97501574b0 2024-09-13T18:05:45.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f97467fc700 1 -- 172.21.15.88:0/770723278 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7f974c054aa0 con 0x7f97501574b0 2024-09-13T18:05:45.631 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:45.631 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:05:45.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 msgr2=0x7f9734068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 0x7f9734068bf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f97400017a0 tx=0x7f9740009040 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 msgr2=0x7f97501e9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e8a0 tx=0x7f974c00ec60 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 shutdown_connections 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9734066730 0x7f9734068bf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97501613e0 0x7f97500c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97501574b0 0x7f97501e9ff0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 --2- 172.21.15.88:0/770723278 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97500c1f70 0x7f975006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 >> 172.21.15.88:0/770723278 conn(0x7f97500ca720 msgr2=0x7f97500c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 shutdown_connections 2024-09-13T18:05:45.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:45.628+0000 7f9756c9d700 1 -- 172.21.15.88:0/770723278 wait complete. 2024-09-13T18:05:45.635 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:05:46.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:05:26.465742+0000', 'modified': '2024-09-13T18:05:43.557503+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4294, 'mds_1': 4285, 'mds_2': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'e', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.88:6837/4078470559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6836', 'nonce': 4078470559}, {'type': 'v1', 'addr': '172.21.15.88:6837', 'nonce': 4078470559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4285': {'gid': 4285, 'name': 'f', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.94:6836/135986553', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6834', 'nonce': 135986553}, {'type': 'v1', 'addr': '172.21.15.94:6836', 'nonce': 135986553}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4294': {'gid': 4294, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.94:6839/2424350454', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.94:6838', 'nonce': 2424350454}, {'type': 'v1', 'addr': '172.21.15.94:6839', 'nonce': 2424350454}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:05:46.249 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-13T18:05:46.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-09-13T18:05:46.344 INFO:tasks.ceph.mds.d.smithi094.stderr:2024-09-13T18:05:46.338+0000 7f7ae2990700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-13T18:05:46.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.368+0000 7fe33bbe1700 1 Processor -- start 2024-09-13T18:05:46.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.368+0000 7fe33bbe1700 1 -- start start 2024-09-13T18:05:46.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe33406ddc0 0x7fe334156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406e1a0 0x7fe3340c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe33406f580 0x7fe3341508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3340c2a30 con 0x7fe33406ddc0 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3340c1d30 con 0x7fe33406f580 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3340c3be0 con 0x7fe33406e1a0 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe33406ddc0 0x7fe334156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe33406ddc0 0x7fe334156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50966/0 (socket says 172.21.15.88:50966) 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 -- 172.21.15.88:0/1755998502 learned_addr learned my addr 172.21.15.88:0/1755998502 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33a17e700 1 --2- 172.21.15.88:0/1755998502 >> v2:172.21.15.94:3300/0 conn(0x7fe33406f580 0x7fe3341508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33917c700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406e1a0 0x7fe3340c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 -- 172.21.15.88:0/1755998502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406e1a0 msgr2=0x7fe3340c24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406e1a0 0x7fe3340c24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 -- 172.21.15.88:0/1755998502 >> v2:172.21.15.94:3300/0 conn(0x7fe33406f580 msgr2=0x7fe3341508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 --2- 172.21.15.88:0/1755998502 >> v2:172.21.15.94:3300/0 conn(0x7fe33406f580 0x7fe3341508a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 -- 172.21.15.88:0/1755998502 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3340c4360 con 0x7fe33406ddc0 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33997d700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406ddc0 0x7fe334156e80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe33406e670 tx=0x7fe330009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38356929946c32c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33897b700 1 -- 172.21.15.88:0/1755998502 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330011830 con 0x7fe33406ddc0 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33897b700 1 -- 172.21.15.88:0/1755998502 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330011990 con 0x7fe33406ddc0 2024-09-13T18:05:46.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33897b700 1 -- 172.21.15.88:0/1755998502 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330011d40 con 0x7fe33406ddc0 2024-09-13T18:05:46.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1755998502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406ddc0 msgr2=0x7fe334156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:46.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406ddc0 0x7fe334156e80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe33406e670 tx=0x7fe330009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1755998502 shutdown_connections 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406e1a0 0x7fe3340c24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1755998502 >> v2:172.21.15.94:3300/0 conn(0x7fe33406f580 0x7fe3341508a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1755998502 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406ddc0 0x7fe334156e80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1755998502 >> 172.21.15.88:0/1755998502 conn(0x7fe3340ca790 msgr2=0x7fe3340caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1755998502 shutdown_connections 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.372+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1755998502 wait complete. 2024-09-13T18:05:46.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 Processor -- start 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- start start 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe33406ddc0 0x7fe334154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 0x7fe3341522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334152820 con 0x7fe33406e1a0 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe334152a90 con 0x7fe33406ddc0 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe334152d70 con 0x7fe33406f580 2024-09-13T18:05:46.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50976/0 (socket says 172.21.15.88:50976) 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 -- 172.21.15.88:0/1263726366 learned_addr learned my addr 172.21.15.88:0/1263726366 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33a17e700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 0x7fe3341522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33997d700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe33406ddc0 0x7fe334154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 -- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 msgr2=0x7fe3341522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 0x7fe3341522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 -- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe33406ddc0 msgr2=0x7fe334154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:46.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe33406ddc0 0x7fe334154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 -- 172.21.15.88:0/1263726366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330009570 con 0x7fe33406e1a0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33a17e700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 0x7fe3341522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33917c700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e900 tx=0x7fe32400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe32a7fc700 1 -- 172.21.15.88:0/1263726366 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324009660 con 0x7fe33406e1a0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe32a7fc700 1 -- 172.21.15.88:0/1263726366 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400c850 con 0x7fe33406e1a0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe334153050 con 0x7fe33406e1a0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe32a7fc700 1 -- 172.21.15.88:0/1263726366 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400cbe0 con 0x7fe33406e1a0 2024-09-13T18:05:46.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.376+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe334153960 con 0x7fe33406e1a0 2024-09-13T18:05:46.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe32a7fc700 1 -- 172.21.15.88:0/1263726366 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe32400cd40 con 0x7fe33406e1a0 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe32a7fc700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 0x7fe318068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe32a7fc700 1 -- 172.21.15.88:0/1263726366 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe324084300 con 0x7fe33406e1a0 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe33997d700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 0x7fe318068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe33997d700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 0x7fe318068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe330009910 tx=0x7fe330008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe33ee92740 1 Processor -- start 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.380+0000 7fe33ee92740 1 -- start start 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x13edd80 con 0x14a2d00 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x13eb510 con 0x14a3620 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x13e6e00 con 0x14b6ba0 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50986/0 (socket says 172.21.15.88:50986) 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 -- 172.21.15.88:0/3516638275 learned_addr learned my addr 172.21.15.88:0/3516638275 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33a17e700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33997d700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 -- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 msgr2=0x14a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 -- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 msgr2=0x14a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 -- 172.21.15.88:0/3516638275 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1259960 con 0x14a2d00 2024-09-13T18:05:46.391 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33a17e700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33917c700 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe324051790 tx=0x7fe324055a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be34e0318a0534c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe3177fe700 1 -- 172.21.15.88:0/3516638275 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32405d680 con 0x14a2d00 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe3177fe700 1 -- 172.21.15.88:0/3516638275 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324053630 con 0x14a2d00 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe3177fe700 1 -- 172.21.15.88:0/3516638275 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324055710 con 0x14a2d00 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- 172.21.15.88:0/3516638275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 msgr2=0x14a30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe324051790 tx=0x7fe324055a60 comp rx=0 tx=0).stop 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- 172.21.15.88:0/3516638275 shutdown_connections 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14a30e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3516638275 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- 172.21.15.88:0/3516638275 >> 172.21.15.88:0/3516638275 conn(0x120e4d0 msgr2=0x14b9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- 172.21.15.88:0/3516638275 shutdown_connections 2024-09-13T18:05:46.392 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.384+0000 7fe33ee92740 1 -- 172.21.15.88:0/3516638275 wait complete. 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 -- start start 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 Processor -- start 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14b9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x13a4730 con 0x14a2d00 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x13aa5b0 con 0x14a3620 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x1292aa0 con 0x14b6ba0 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 10 client.0 _ll_register_callbacks cb 0x13e0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51002/0 (socket says 172.21.15.88:51002) 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 -- 172.21.15.88:0/3870494766 learned_addr learned my addr 172.21.15.88:0/3870494766 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33917c700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14b9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33a17e700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 -- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 msgr2=0x14c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 -- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 msgr2=0x14b9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14b9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 -- 172.21.15.88:0/3870494766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe334153960 con 0x14a2d00 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33997d700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe334072a80 tx=0x7fe3300047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d928f9c4bf8972 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe314ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe330003ad0 con 0x14a2d00 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe330003c30 con 0x14a2d00 2024-09-13T18:05:46.397 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.388+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x121b1e0 con 0x14a2d00 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe330003df0 con 0x14a2d00 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 10 client.4695 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x13ad220 con 0x14a2d00 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x121b1e0 con 0x14a2d00 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7fe330033470 con 0x14a2d00 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 10 client.4695 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 10 client.4695 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 20 client.4695 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x14cb4b0 0x14cb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 4 client.4695 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 --> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1265460 con 0x14cb4b0 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33917c700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x14cb4b0 0x14cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:46.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe314ff9700 10 client.4695 ms_handle_connect on v2:172.21.15.88:6836/4078470559 2024-09-13T18:05:46.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:46.392+0000 7fe33917c700 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x14cb4b0 0x14cb890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3326e6d0b15c2189 server_cookie=2d5769a4565468dc in_seq=0 out_seq=0 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.564+0000 7fe314ff9700 1 -- 172.21.15.88:0/3870494766 <== mds.2 v2:172.21.15.88:6836/4078470559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x1265460 con 0x14cb4b0 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.564+0000 7fe314ff9700 10 client.4695 handle_command_reply: tid=0 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.564+0000 7fe33ee92740 1 client.4695 shutdown 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 msgr2=0x14b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe334072a80 tx=0x7fe3300047e0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 shutdown_connections 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x14cb4b0 0x14cb890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14b9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe314ff9700 0 client.4695 ms_handle_reset on v2:172.21.15.88:6836/4078470559 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 --2- 172.21.15.88:0/3870494766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b9970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 >> 172.21.15.88:0/3870494766 conn(0x120e4d0 msgr2=0x14b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 shutdown_connections 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 1 -- 172.21.15.88:0/3870494766 wait complete. 2024-09-13T18:05:48.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.568+0000 7fe33ee92740 20 client.4695 trim_cache size 0 max 16384 2024-09-13T18:05:48.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 Processor -- start 2024-09-13T18:05:48.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 -- start start 2024-09-13T18:05:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x1415ec0 con 0x14a2d00 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x14c7960 con 0x14a3620 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x13ea6e0 con 0x14b6ba0 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51006/0 (socket says 172.21.15.88:51006) 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33917c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33a17e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 -- 172.21.15.88:0/919944376 learned_addr learned my addr 172.21.15.88:0/919944376 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 -- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 msgr2=0x14a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 -- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 msgr2=0x14a3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33997d700 1 -- 172.21.15.88:0/919944376 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1393450 con 0x14a2d00 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.588+0000 7fe33917c700 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33997d700 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe330009810 tx=0x7fe33002c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb7f640b031335f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe317fff700 1 -- 172.21.15.88:0/919944376 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300339d0 con 0x14a2d00 2024-09-13T18:05:48.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe317fff700 1 -- 172.21.15.88:0/919944376 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe330011b00 con 0x14a2d00 2024-09-13T18:05:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe317fff700 1 -- 172.21.15.88:0/919944376 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3300038d0 con 0x14a2d00 2024-09-13T18:05:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- 172.21.15.88:0/919944376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 msgr2=0x14b6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe330009810 tx=0x7fe33002c070 comp rx=0 tx=0).stop 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- 172.21.15.88:0/919944376 shutdown_connections 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14b6ba0 0x14a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a3620 0x14a3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 --2- 172.21.15.88:0/919944376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14a2d00 0x14b6620 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- 172.21.15.88:0/919944376 >> 172.21.15.88:0/919944376 conn(0x120e4d0 msgr2=0x14a2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- 172.21.15.88:0/919944376 shutdown_connections 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- 172.21.15.88:0/919944376 wait complete. 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 -- start start 2024-09-13T18:05:48.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.592+0000 7fe33ee92740 1 Processor -- start 2024-09-13T18:05:48.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 0x1480a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14a3620 0x147e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x13b14f0 con 0x14b6ba0 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x14d1f40 con 0x14a2d00 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x14c9010 con 0x14a3620 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 10 client.0 _ll_register_callbacks cb 0x7fe324055060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51020/0 (socket says 172.21.15.88:51020) 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 -- 172.21.15.88:0/252926656 learned_addr learned my addr 172.21.15.88:0/252926656 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33997d700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 0x1480a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33917c700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14a3620 0x147e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 -- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14a3620 msgr2=0x147e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14a3620 0x147e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 -- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 msgr2=0x1480a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 0x1480a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 -- 172.21.15.88:0/252926656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1259960 con 0x14b6ba0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33997d700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 0x1480a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33a17e700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009c30 tx=0x7fe32c019f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b197442dbdc4f01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00e040 con 0x14b6ba0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe32c019050 con 0x14b6ba0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe324053630 con 0x14b6ba0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe32c017eb0 con 0x14b6ba0 2024-09-13T18:05:48.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 10 client.4701 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x13ad220 con 0x14b6ba0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe324053630 con 0x14b6ba0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7fe32c019210 con 0x14b6ba0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 10 client.4701 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 10 client.4701 resolve_mds: resolved name 'e' to daemon mds.e 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 20 client.4701 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x151dad0 0x1526f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 4 client.4701 mds_command: new command op to 4263 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 --> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] -- command(tid 0: {"prefix": "status"}) v1 -- 0x128a1e0 con 0x151dad0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.596+0000 7fe33997d700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x151dad0 0x1526f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33997d700 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x151dad0 0x1526f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a24415d13edaf50c server_cookie=e1a4deb217a12f0b in_seq=0 out_seq=0 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe314ff9700 10 client.4701 ms_handle_connect on v2:172.21.15.88:6836/4078470559 2024-09-13T18:05:48.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe314ff9700 1 -- 172.21.15.88:0/252926656 <== mds.2 v2:172.21.15.88:6836/4078470559 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x128a1e0 con 0x151dad0 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe314ff9700 10 client.4701 handle_command_reply: tid=0 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 client.4701 shutdown 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 msgr2=0x147e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009c30 tx=0x7fe32c019f90 comp rx=0 tx=0).stop 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 shutdown_connections 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:6836/4078470559,v1:172.21.15.88:6837/4078470559] conn(0x151dad0 0x1526f00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x14a3620 0x147e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe314ff9700 0 client.4701 ms_handle_reset on v2:172.21.15.88:6836/4078470559 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x14b6ba0 0x147e7a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 --2- 172.21.15.88:0/252926656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x14a2d00 0x1480a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 >> 172.21.15.88:0/252926656 conn(0x120e4d0 msgr2=0x14a3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 shutdown_connections 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 1 -- 172.21.15.88:0/252926656 wait complete. 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33ee92740 20 client.4701 trim_cache size 0 max 16384 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 2, 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4263, 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-09-13T18:05:48.607 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 11.061421636, 2024-09-13T18:05:48.608 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 12, 2024-09-13T18:05:48.608 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2024-09-13T18:05:48.608 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:05:48.608 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 28.285801155000001 2024-09-13T18:05:48.608 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 msgr2=0x7fe318068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 0x7fe318068bf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe330009910 tx=0x7fe330008030 comp rx=0 tx=0).stop 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 msgr2=0x7fe334154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe32400e900 tx=0x7fe32400ecc0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 shutdown_connections 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe318066730 0x7fe318068bf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe33406f580 0x7fe3341522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe33406e1a0 0x7fe334154160 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 --2- 172.21.15.88:0/1263726366 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe33406ddc0 0x7fe334154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 >> 172.21.15.88:0/1263726366 conn(0x7fe3340ca790 msgr2=0x7fe33414c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 shutdown_connections 2024-09-13T18:05:48.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.600+0000 7fe33bbe1700 1 -- 172.21.15.88:0/1263726366 wait complete. 2024-09-13T18:05:48.622 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-09-13T18:05:48.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 Processor -- start 2024-09-13T18:05:48.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 -- start start 2024-09-13T18:05:48.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fabbc155ba0 0x7fabbc14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabbc0c1570 0x7fabbc14ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc06ce90 con 0x7fabbc06bfd0 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc06d170 con 0x7fabbc0c1570 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc251f700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc06d450 con 0x7fabbc155ba0 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabbc0c1570 0x7fabbc14ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc0d1c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fabbc155ba0 0x7fabbc14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fabbc0c1570 0x7fabbc14ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51026/0 (socket says 172.21.15.88:51026) 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 -- 172.21.15.88:0/3709080918 learned_addr learned my addr 172.21.15.88:0/3709080918 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc151d700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fabbc06bfd0 0x7fabbc06c3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:43266/0 (socket says 172.21.15.88:43266) 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 -- 172.21.15.88:0/3709080918 >> v2:172.21.15.94:3300/0 conn(0x7fabbc155ba0 msgr2=0x7fabbc14fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3709080918 >> v2:172.21.15.94:3300/0 conn(0x7fabbc155ba0 0x7fabbc14fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 -- 172.21.15.88:0/3709080918 >> v1:172.21.15.94:6789/0 conn(0x7fabbc06bfd0 legacy=0x7fabbc06c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 -- 172.21.15.88:0/3709080918 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc06d730 con 0x7fabbc0c1570 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3709080918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc14ff80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabbc06fc90 tx=0x7fabac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6674f0817854a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabb3fff700 1 -- 172.21.15.88:0/3709080918 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011830 con 0x7fabbc0c1570 2024-09-13T18:05:48.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabb3fff700 1 -- 172.21.15.88:0/3709080918 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac011990 con 0x7fabbc0c1570 2024-09-13T18:05:48.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.740+0000 7fabb3fff700 1 -- 172.21.15.88:0/3709080918 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac011d20 con 0x7fabbc0c1570 2024-09-13T18:05:48.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- 172.21.15.88:0/3709080918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 msgr2=0x7fabbc14ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- 172.21.15.88:0/3709080918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc14ff80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabbc06fc90 tx=0x7fabac009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- 172.21.15.88:0/3709080918 shutdown_connections 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- 172.21.15.88:0/3709080918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc14ff80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- 172.21.15.88:0/3709080918 >> v2:172.21.15.94:3300/0 conn(0x7fabbc155ba0 0x7fabbc14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- 172.21.15.88:0/3709080918 >> 172.21.15.88:0/3709080918 conn(0x7fabbc0664b0 msgr2=0x7fabbc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- 172.21.15.88:0/3709080918 shutdown_connections 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- 172.21.15.88:0/3709080918 wait complete. 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 Processor -- start 2024-09-13T18:05:48.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- start start 2024-09-13T18:05:48.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fabbc06bfd0 0x7fabbc1422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 0x7fabbc14a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc141ab0 con 0x7fabbc0c1570 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c4a80 con 0x7fabbc14be70 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc251f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c44c0 con 0x7fabbc06bfd0 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51028/0 (socket says 172.21.15.88:51028) 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3214303619 learned_addr learned my addr 172.21.15.88:0/3214303619 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 0x7fabbc14a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc151d700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fabbc06bfd0 0x7fabbc1422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fabbc06bfd0 msgr2=0x7fabbc1422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fabbc06bfd0 0x7fabbc1422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 msgr2=0x7fabbc14a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 0x7fabbc14a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3214303619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac009570 con 0x7fabbc0c1570 2024-09-13T18:05:48.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 0x7fabbc14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.744+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fabb800e9d0 tx=0x7fabb800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 -- 172.21.15.88:0/3214303619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb8009720 con 0x7fabbc0c1570 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 -- 172.21.15.88:0/3214303619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb800c850 con 0x7fabbc0c1570 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabbc0c47a0 con 0x7fabbc0c1570 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 -- 172.21.15.88:0/3214303619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb800cbc0 con 0x7fabbc0c1570 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc1412b0 con 0x7fabbc0c1570 2024-09-13T18:05:48.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 -- 172.21.15.88:0/3214303619 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fabb800cd20 con 0x7fabbc0c1570 2024-09-13T18:05:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 0x7faba0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabb1ffb700 1 -- 172.21.15.88:0/3214303619 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb80841b0 con 0x7fabbc0c1570 2024-09-13T18:05:48.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.748+0000 7fabc151d700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 0x7faba0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.752+0000 7fabc151d700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 0x7faba0068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fabb40012e0 tx=0x7fabb40018a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.752+0000 7fabc6a32740 1 Processor -- start 2024-09-13T18:05:48.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.752+0000 7fabc6a32740 1 -- start start 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 0x2bba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2bbac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b04d80 con 0x2bcddb0 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b02510 con 0x2bba830 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x2afde00 con 0x2bb9f10 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc0d1c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 0x2bba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51038/0 (socket says 172.21.15.88:51038) 2024-09-13T18:05:48.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2bbac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 0x2bba2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:57740/0 (socket says 172.21.15.88:57740) 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 -- 172.21.15.88:0/3727107233 learned_addr learned my addr 172.21.15.88:0/3727107233 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 -- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 msgr2=0x2bba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 0x2bba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 -- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 msgr2=0x2bbac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2bbac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 -- 172.21.15.88:0/3727107233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2970960 con 0x2bcddb0 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7fabc151d700 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007c10 tx=0x7fabb4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3d6a431524c7e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7faba6ffd700 1 -- 172.21.15.88:0/3727107233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40079b0 con 0x2bcddb0 2024-09-13T18:05:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7faba6ffd700 1 -- 172.21.15.88:0/3727107233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4015bb0 con 0x2bcddb0 2024-09-13T18:05:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.756+0000 7faba6ffd700 1 -- 172.21.15.88:0/3727107233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4021450 con 0x2bcddb0 2024-09-13T18:05:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/3727107233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 msgr2=0x2bb99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fabb4007c10 tx=0x7fabb4012000 comp rx=0 tx=0).stop 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/3727107233 shutdown_connections 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bb9f10 0x2bba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2bbac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3727107233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bcddb0 0x2bb99d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/3727107233 >> 172.21.15.88:0/3727107233 conn(0x29254d0 msgr2=0x2bd0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/3727107233 shutdown_connections 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/3727107233 wait complete. 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- start start 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 Processor -- start 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 0x2be29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2abb730 con 0x2bb9f10 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac15b0 con 0x2bba830 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x29a9aa0 con 0x2bcddb0 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 10 client.0 _ll_register_callbacks cb 0x2af7610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51052/0 (socket says 172.21.15.88:51052) 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 -- 172.21.15.88:0/718859917 learned_addr learned my addr 172.21.15.88:0/718859917 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 0x2be29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 -- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 msgr2=0x2be29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 0x2be29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.769 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 -- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 msgr2=0x2be2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 -- 172.21.15.88:0/718859917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb400f040 con 0x2bb9f10 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 0x2be29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc151d700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabb40150e0 tx=0x7fabb4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b1c158f152c59b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fab9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4028040 con 0x2bb9f10 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb402eae0 con 0x2bb9f10 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29321e0 con 0x2bb9f10 2024-09-13T18:05:48.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb402eca0 con 0x2bb9f10 2024-09-13T18:05:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 10 client.4713 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x2ac4220 con 0x2bb9f10 2024-09-13T18:05:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.760+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29321e0 con 0x2bb9f10 2024-09-13T18:05:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7fabb4021820 con 0x2bb9f10 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 10 client.4713 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 10 client.4713 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 20 client.4713 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2b94bf0 0x2b94fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 4 client.4713 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 --> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x297c460 con 0x2b94bf0 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2b94bf0 0x2b94fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fab9bfff700 10 client.4713 ms_handle_connect on v2:172.21.15.94:6834/135986553 2024-09-13T18:05:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2b94bf0 0x2b94fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e9a838251f5eeb81 server_cookie=cc10b9570bb079f5 in_seq=0 out_seq=0 2024-09-13T18:05:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fab9bfff700 1 -- 172.21.15.88:0/718859917 <== mds.1 v2:172.21.15.94:6834/135986553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x297c460 con 0x2b94bf0 2024-09-13T18:05:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fab9bfff700 10 client.4713 handle_command_reply: tid=0 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 client.4713 shutdown 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 msgr2=0x2bd0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fabb40150e0 tx=0x7fabb4011000 comp rx=0 tx=0).stop 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 shutdown_connections 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2b94bf0 0x2b94fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bcddb0 0x2be29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fab9bfff700 0 client.4713 ms_handle_reset on v2:172.21.15.94:6834/135986553 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 --2- 172.21.15.88:0/718859917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2bd0b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 >> 172.21.15.88:0/718859917 conn(0x29254d0 msgr2=0x2bce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 shutdown_connections 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 1 -- 172.21.15.88:0/718859917 wait complete. 2024-09-13T18:05:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.764+0000 7fabc6a32740 20 client.4713 trim_cache size 0 max 16384 2024-09-13T18:05:48.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 Processor -- start 2024-09-13T18:05:48.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 -- start start 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bb9f10 0x2bdef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 0x2bdf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b2cec0 con 0x2b94bf0 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9c470 con 0x2bb9f10 2024-09-13T18:05:48.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ac84f0 con 0x2bba830 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51056/0 (socket says 172.21.15.88:51056) 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 -- 172.21.15.88:0/1474610891 learned_addr learned my addr 172.21.15.88:0/1474610891 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bb9f10 0x2bdef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 0x2bdf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 -- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 msgr2=0x2bdf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 0x2bdf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 -- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bb9f10 msgr2=0x2bdef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bb9f10 0x2bdef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc151d700 1 -- 172.21.15.88:0/1474610891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2aaa450 con 0x2b94bf0 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.788+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 0x2bdf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:48.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc151d700 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabb4002020 tx=0x7fabb4017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6fea59a747e6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7faba77fe700 1 -- 172.21.15.88:0/1474610891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4028020 con 0x2b94bf0 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7faba77fe700 1 -- 172.21.15.88:0/1474610891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4019070 con 0x2b94bf0 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7faba77fe700 1 -- 172.21.15.88:0/1474610891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb4021d30 con 0x2b94bf0 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- 172.21.15.88:0/1474610891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 msgr2=0x2be9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabb4002020 tx=0x7fabb4017070 comp rx=0 tx=0).stop 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- 172.21.15.88:0/1474610891 shutdown_connections 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2bba830 0x2bdf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bb9f10 0x2bdef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- 172.21.15.88:0/1474610891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2b94bf0 0x2be9000 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- 172.21.15.88:0/1474610891 >> 172.21.15.88:0/1474610891 conn(0x29254d0 msgr2=0x2bd09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- 172.21.15.88:0/1474610891 shutdown_connections 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- 172.21.15.88:0/1474610891 wait complete. 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- start start 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 Processor -- start 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2b94bf0 0x2c33a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab7c30 con 0x2bb9f10 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bcd400 con 0x2bba830 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x2bdc990 con 0x2b94bf0 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc6a32740 10 client.0 _ll_register_callbacks cb 0x2aafce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc151d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2b94bf0 0x2c33a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51070/0 (socket says 172.21.15.88:51070) 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3708977403 learned_addr learned my addr 172.21.15.88:0/3708977403 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc1d1e700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2b94bf0 msgr2=0x2c33a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2b94bf0 0x2c33a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 msgr2=0x2be3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 -- 172.21.15.88:0/3708977403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2ac4220 con 0x2bb9f10 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fabc0d1c700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabb8054f70 tx=0x7fabb8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf66f1f88196ecda server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.800 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.792+0000 7fab9bfff700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb80554d0 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb806c040 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabb4015bb0 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabb8055630 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 10 client.4719 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x2a9e720 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb4015bb0 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7fabb8054760 con 0x2bb9f10 2024-09-13T18:05:48.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 10 client.4719 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 10 client.4719 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 20 client.4719 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2bcddb0 0x2be4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 4 client.4719 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 --> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] -- command(tid 0: {"prefix": "status"}) v1 -- 0x29a11e0 con 0x2bcddb0 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc151d700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2bcddb0 0x2be4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 10 client.4719 ms_handle_connect on v2:172.21.15.94:6834/135986553 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc151d700 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2bcddb0 0x2be4530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d62858e48d2a0bb6 server_cookie=2c530a26ce335364 in_seq=0 out_seq=0 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 1 -- 172.21.15.88:0/3708977403 <== mds.1 v2:172.21.15.94:6834/135986553 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x29a11e0 con 0x2bcddb0 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 10 client.4719 handle_command_reply: tid=0 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 client.4719 shutdown 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 msgr2=0x2be6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.804 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fabb8054f70 tx=0x7fabb8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 shutdown_connections 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:6834/135986553,v1:172.21.15.94:6836/135986553] conn(0x2bcddb0 0x2be4530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2bba830 0x2be3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fab9bfff700 0 client.4719 ms_handle_reset on v2:172.21.15.94:6834/135986553 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2bb9f10 0x2be6420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 --2- 172.21.15.88:0/3708977403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x2b94bf0 0x2c33a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 >> 172.21.15.88:0/3708977403 conn(0x29254d0 msgr2=0x2b93f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 shutdown_connections 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 1 -- 172.21.15.88:0/3708977403 wait complete. 2024-09-13T18:05:48.805 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.796+0000 7fabc6a32740 20 client.4719 trim_cache size 0 max 16384 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 1, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4285, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 17.294691436000001, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 12, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 28.486898163999999 2024-09-13T18:05:48.806 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:48.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 msgr2=0x7faba0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 0x7faba0068bf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fabb40012e0 tx=0x7fabb40018a0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 msgr2=0x7fabbc0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fabb800e9d0 tx=0x7fabb800ed90 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 shutdown_connections 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faba0066730 0x7faba0068bf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fabbc14be70 0x7fabbc14a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fabbc0c1570 0x7fabbc0c9c60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 --2- 172.21.15.88:0/3214303619 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fabbc06bfd0 0x7fabbc1422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 >> 172.21.15.88:0/3214303619 conn(0x7fabbc0664b0 msgr2=0x7fabbc1e23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 shutdown_connections 2024-09-13T18:05:48.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.800+0000 7fabc251f700 1 -- 172.21.15.88:0/3214303619 wait complete. 2024-09-13T18:05:48.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:05:48.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 Processor -- start 2024-09-13T18:05:48.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 -- start start 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1dd80d5640 0x7f1dd8045700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd80d5a20 con 0x7f1dd80464b0 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd80dbe40 con 0x7f1dd8050820 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.928+0000 7f1ddf59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd8035950 con 0x7f1dd80d5640 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dde59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1dd80d5640 0x7f1dd8045700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dded9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1dd80464b0 0x7f1dd8035240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45912/0 (socket says 172.21.15.88:45912) 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dded9d700 1 -- 172.21.15.88:0/1324655791 learned_addr learned my addr 172.21.15.88:0/1324655791 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dde59c700 1 -- 172.21.15.88:0/1324655791 >> v1:172.21.15.94:6789/0 conn(0x7f1dd8050820 legacy=0x7f1dd8034b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dde59c700 1 -- 172.21.15.88:0/1324655791 >> v1:172.21.15.88:6789/0 conn(0x7f1dd80464b0 legacy=0x7f1dd8035240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dde59c700 1 -- 172.21.15.88:0/1324655791 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80dc120 con 0x7f1dd80d5640 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddd59a700 1 -- 172.21.15.88:0/1324655791 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458044909 0 0) 0x7f1dd80d5a20 con 0x7f1dd80464b0 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1dde59c700 1 --2- 172.21.15.88:0/1324655791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80d5640 0x7f1dd8045700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009850 tx=0x7f1dd0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda0e51de5c4087f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddd59a700 1 -- 172.21.15.88:0/1324655791 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011830 con 0x7f1dd80d5640 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddd59a700 1 -- 172.21.15.88:0/1324655791 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd0011990 con 0x7f1dd80d5640 2024-09-13T18:05:48.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddd59a700 1 -- 172.21.15.88:0/1324655791 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0011d20 con 0x7f1dd80d5640 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 -- 172.21.15.88:0/1324655791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80d5640 msgr2=0x7f1dd8045700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/1324655791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80d5640 0x7f1dd8045700 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009850 tx=0x7f1dd0009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 -- 172.21.15.88:0/1324655791 shutdown_connections 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/1324655791 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80d5640 0x7f1dd8045700 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 -- 172.21.15.88:0/1324655791 >> 172.21.15.88:0/1324655791 conn(0x7f1dd804fd00 msgr2=0x7f1dd8050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 -- 172.21.15.88:0/1324655791 shutdown_connections 2024-09-13T18:05:48.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.932+0000 7f1ddf59e700 1 -- 172.21.15.88:0/1324655791 wait complete. 2024-09-13T18:05:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 Processor -- start 2024-09-13T18:05:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 -- start start 2024-09-13T18:05:48.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1dd8050820 0x7f1dd8047ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dd80d5640 0x7f1dd8171b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd8172050 con 0x7f1dd80464b0 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80ce590 con 0x7f1dd80d5640 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1ddf59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd80ce850 con 0x7f1dd8050820 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51088/0 (socket says 172.21.15.88:51088) 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 -- 172.21.15.88:0/2625169192 learned_addr learned my addr 172.21.15.88:0/2625169192 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1dd8050820 0x7f1dd8047ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dded9d700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dd80d5640 0x7f1dd8171b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 -- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1dd8050820 msgr2=0x7f1dd8047ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1dd8050820 0x7f1dd8047ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 -- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dd80d5640 msgr2=0x7f1dd8171b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dd80d5640 0x7f1dd8171b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 -- 172.21.15.88:0/2625169192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00094b0 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009fd0 tx=0x7f1dd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.936+0000 7f1dceffd700 1 -- 172.21.15.88:0/2625169192 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0006ea0 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dceffd700 1 -- 172.21.15.88:0/2625169192 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd001e070 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dceffd700 1 -- 172.21.15.88:0/2625169192 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0003b00 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd80ceb30 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd8047000 con 0x7f1dd80464b0 2024-09-13T18:05:48.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dceffd700 1 -- 172.21.15.88:0/2625169192 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1dd0003c60 con 0x7f1dd80464b0 2024-09-13T18:05:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dceffd700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 0x7f1dc0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dceffd700 1 -- 172.21.15.88:0/2625169192 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dd00851c0 con 0x7f1dd80464b0 2024-09-13T18:05:48.945 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.940+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 0x7f1dc0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.946 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 0x7f1dc0068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1dd804ee90 tx=0x7f1dd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 Processor -- start 2024-09-13T18:05:48.947 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 -- start start 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x25089d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x2509c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2453d80 con 0x2508f10 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2451510 con 0x2509830 2024-09-13T18:05:48.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x244ce00 con 0x251cdb0 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51100/0 (socket says 172.21.15.88:51100) 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 -- 172.21.15.88:0/676126580 learned_addr learned my addr 172.21.15.88:0/676126580 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dde59c700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x25089d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dded9d700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x2509c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 -- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 msgr2=0x25089d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x25089d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 -- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 msgr2=0x2509c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x2509c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 -- 172.21.15.88:0/676126580 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22bf960 con 0x2508f10 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dded9d700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x2509c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005360 tx=0x7f1dd4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75493a185fe71522 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dbffff700 1 -- 172.21.15.88:0/676126580 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005100 con 0x2508f10 2024-09-13T18:05:48.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dbffff700 1 -- 172.21.15.88:0/676126580 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4003d40 con 0x2508f10 2024-09-13T18:05:48.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.944+0000 7f1dbffff700 1 -- 172.21.15.88:0/676126580 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4021650 con 0x2508f10 2024-09-13T18:05:48.954 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- 172.21.15.88:0/676126580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 msgr2=0x25092f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4005360 tx=0x7f1dd4011000 comp rx=0 tx=0).stop 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- 172.21.15.88:0/676126580 shutdown_connections 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x2509c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x25092f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- 172.21.15.88:0/676126580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x25089d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- 172.21.15.88:0/676126580 >> 172.21.15.88:0/676126580 conn(0x22744d0 msgr2=0x251fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- 172.21.15.88:0/676126580 shutdown_connections 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- 172.21.15.88:0/676126580 wait complete. 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- start start 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 Processor -- start 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x24e4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x2506770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x240a730 con 0x2509830 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x24105b0 con 0x2508f10 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x22f8aa0 con 0x251cdb0 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1de8065740 10 client.0 _ll_register_callbacks cb 0x2446610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1dde59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x24e4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51106/0 (socket says 172.21.15.88:51106) 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1dddd9b700 1 -- 172.21.15.88:0/3323229439 learned_addr learned my addr 172.21.15.88:0/3323229439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.948+0000 7f1dded9d700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x2506770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 -- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 msgr2=0x2506770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x2506770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 -- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 msgr2=0x24e4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x24e4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 -- 172.21.15.88:0/3323229439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd400f040 con 0x2509830 2024-09-13T18:05:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dde59c700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x24e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4003980 tx=0x7f1dd4005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e700afada01c4fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4028040 con 0x2509830 2024-09-13T18:05:48.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dd4021a70 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22811e0 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd4005100 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 10 client.4734 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x2413220 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22811e0 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7f1dd4021c70 con 0x2509830 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 10 client.4734 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 10 client.4734 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 20 client.4734 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2531720 0x2531b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 4 client.4734 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 --> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22cb460 con 0x2531720 2024-09-13T18:05:48.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dde59c700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2531720 0x2531b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dbd7fa700 10 client.4734 ms_handle_connect on v2:172.21.15.94:6838/2424350454 2024-09-13T18:05:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.952+0000 7f1dde59c700 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2531720 0x2531b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42325b18672ce76f server_cookie=b1cbb046a017cb71 in_seq=0 out_seq=0 2024-09-13T18:05:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/3323229439 <== mds.0 v2:172.21.15.94:6838/2424350454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x22cb460 con 0x2531720 2024-09-13T18:05:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1dbd7fa700 10 client.4734 handle_command_reply: tid=0 2024-09-13T18:05:48.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 client.4734 shutdown 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 msgr2=0x24e5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4003980 tx=0x7f1dd4005000 comp rx=0 tx=0).stop 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 shutdown_connections 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2531720 0x2531b00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x2506770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e5290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 --2- 172.21.15.88:0/3323229439 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x24e4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1dbd7fa700 0 client.4734 ms_handle_reset on v2:172.21.15.94:6838/2424350454 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 >> 172.21.15.88:0/3323229439 conn(0x22744d0 msgr2=0x251d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 shutdown_connections 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 1 -- 172.21.15.88:0/3323229439 wait complete. 2024-09-13T18:05:48.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.956+0000 7f1de8065740 20 client.4734 trim_cache size 0 max 16384 2024-09-13T18:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 Processor -- start 2024-09-13T18:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 -- start start 2024-09-13T18:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x251bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x24e4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x247bec0 con 0x2509830 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x251c4e0 con 0x2508f10 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x23fcd70 con 0x251cdb0 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51116/0 (socket says 172.21.15.88:51116) 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1dddd9b700 1 -- 172.21.15.88:0/1539313182 learned_addr learned my addr 172.21.15.88:0/1539313182 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1dde59c700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x251bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.976+0000 7f1dded9d700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x24e4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 -- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 msgr2=0x24e4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x24e4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 -- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 msgr2=0x251bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x251bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 -- 172.21.15.88:0/1539313182 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23f9450 con 0x2509830 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dded9d700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x24e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4021760 tx=0x7f1dd4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998a48d0253e26cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dccff9700 1 -- 172.21.15.88:0/1539313182 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4028040 con 0x2509830 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dccff9700 1 -- 172.21.15.88:0/1539313182 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4019030 con 0x2509830 2024-09-13T18:05:48.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1dccff9700 1 -- 172.21.15.88:0/1539313182 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4005100 con 0x2509830 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- 172.21.15.88:0/1539313182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 msgr2=0x24e48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4021760 tx=0x7f1dd4012000 comp rx=0 tx=0).stop 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- 172.21.15.88:0/1539313182 shutdown_connections 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x24e4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2509830 0x24e48b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 --2- 172.21.15.88:0/1539313182 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2508f10 0x251bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- 172.21.15.88:0/1539313182 >> 172.21.15.88:0/1539313182 conn(0x22744d0 msgr2=0x24e6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- 172.21.15.88:0/1539313182 shutdown_connections 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- 172.21.15.88:0/1539313182 wait complete. 2024-09-13T18:05:48.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 -- start start 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.980+0000 7f1de8065740 1 Processor -- start 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x258cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x258d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x2446b70 con 0x2508f10 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x2406c30 con 0x2509830 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x24174f0 con 0x251cdb0 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 10 client.0 _ll_register_callbacks cb 0x23fece0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:05:48.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x258cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51130/0 (socket says 172.21.15.88:51130) 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dddd9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x258cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:44114/0 (socket says 172.21.15.88:44114) 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 -- 172.21.15.88:0/2766213634 learned_addr learned my addr 172.21.15.88:0/2766213634 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dded9d700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x258d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 -- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 msgr2=0x258d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x258d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 -- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 msgr2=0x258cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x258cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 -- 172.21.15.88:0/2766213634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2413220 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dde59c700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00526e0 tx=0x7f1dd0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48d370873fe0859 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0054580 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dd00528f0 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dd4003d40 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dd0052ab0 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 10 client.4740 fetch_fsmap learned FSMap version 12 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x23ed720 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd4003d40 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 12) v1 ==== 4228+0+0 (secure 0 0 0) 0x7f1dd005c0b0 con 0x2508f10 2024-09-13T18:05:48.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 10 client.4740 fetch_fsmap finished waiting for FSMap version 12 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 10 client.4740 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 20 client.4740 populate_metadata read hostname 'smithi088' 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2587270 0x2590520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 4 client.4740 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.984+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 --> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] -- command(tid 0: {"prefix": "status"}) v1 -- 0x22f01e0 con 0x2587270 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2587270 0x2590520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dddd9b700 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2587270 0x2590520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bca3e673e650c838 server_cookie=8bb3e2a7eefdd768 in_seq=0 out_seq=0 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dbd7fa700 10 client.4740 ms_handle_connect on v2:172.21.15.94:6838/2424350454 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dbd7fa700 1 -- 172.21.15.88:0/2766213634 <== mds.0 v2:172.21.15.94:6838/2424350454 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x22f01e0 con 0x2587270 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dbd7fa700 10 client.4740 handle_command_reply: tid=0 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 client.4740 shutdown 2024-09-13T18:05:48.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 msgr2=0x2508520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00526e0 tx=0x7f1dd0009240 comp rx=0 tx=0).stop 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 shutdown_connections 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:6838/2424350454,v1:172.21.15.94:6839/2424350454] conn(0x2587270 0x2590520 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x251cdb0 0x258d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x2509830 0x258cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 --2- 172.21.15.88:0/2766213634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x2508f10 0x2508520 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 >> 172.21.15.88:0/2766213634 conn(0x22744d0 msgr2=0x24e6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1dbd7fa700 0 client.4740 ms_handle_reset on v2:172.21.15.94:6838/2424350454 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 shutdown_connections 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 1 -- 172.21.15.88:0/2766213634 wait complete. 2024-09-13T18:05:48.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1de8065740 20 client.4740 trim_cache size 0 max 16384 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4294, 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2024-09-13T18:05:49.000 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 22.520539408000001, 2024-09-13T18:05:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 12, 2024-09-13T18:05:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 20, 2024-09-13T18:05:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 20, 2024-09-13T18:05:49.001 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 28.673320496999999 2024-09-13T18:05:49.001 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:49.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 msgr2=0x7f1dc0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 0x7f1dc0068c20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1dd804ee90 tx=0x7f1dd4009040 comp rx=0 tx=0).stop 2024-09-13T18:05:49.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 msgr2=0x7f1dd80cf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009fd0 tx=0x7f1dd0004770 comp rx=0 tx=0).stop 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 shutdown_connections 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1dc0066760 0x7f1dc0068c20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1dd8050820 0x7f1dd8047ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1dd80d5640 0x7f1dd8171b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 --2- 172.21.15.88:0/2625169192 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1dd80464b0 0x7f1dd80cf450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 >> 172.21.15.88:0/2625169192 conn(0x7f1dd804fd00 msgr2=0x7f1dd80d9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 shutdown_connections 2024-09-13T18:05:49.003 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:48.988+0000 7f1ddf59e700 1 -- 172.21.15.88:0/2625169192 wait complete. 2024-09-13T18:05:49.008 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:05:49.017 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:05:49.017 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:05:49.018 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:05:49.018 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-13T18:05:49.043 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-13T18:05:49.043 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-13T18:05:49.043 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-13T18:05:49.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:05:49.044 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:49.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.044 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T18:05:49.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.052 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-09-13T18:05:49.073 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2024-09-13T18:05:49.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:05:49.074 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-13T18:05:49.074 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-13T18:05:49.075 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:05:49.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 Processor -- start 2024-09-13T18:05:49.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 -- start start 2024-09-13T18:05:49.193 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f69f414fdb0 0x7f69f4159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f40c18f0 con 0x7f69f4071720 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f41560a0 con 0x7f69f4156530 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f8dbc700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40c23a0 con 0x7f69f414fdb0 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f69f4071720 0x7f69f4160430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45914/0 (socket says 172.21.15.88:45914) 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f3fff700 1 -- 172.21.15.88:0/1465532087 learned_addr learned my addr 172.21.15.88:0/1465532087 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f37fe700 1 --2- 172.21.15.88:0/1465532087 >> v2:172.21.15.88:3300/0 conn(0x7f69f414fdb0 0x7f69f4159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f2ffd700 1 -- 172.21.15.88:0/1465532087 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636161798 0 0) 0x7f69f40c18f0 con 0x7f69f4071720 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f2ffd700 1 -- 172.21.15.88:0/1465532087 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e00035d0 con 0x7f69f4071720 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f37fe700 1 -- 172.21.15.88:0/1465532087 >> v1:172.21.15.94:6789/0 conn(0x7f69f4156530 legacy=0x7f69f40c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f37fe700 1 -- 172.21.15.88:0/1465532087 >> v1:172.21.15.88:6789/0 conn(0x7f69f4071720 legacy=0x7f69f4160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f37fe700 1 -- 172.21.15.88:0/1465532087 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4159fe0 con 0x7f69f414fdb0 2024-09-13T18:05:49.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f37fe700 1 --2- 172.21.15.88:0/1465532087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f4159100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009850 tx=0x7f69dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1dd012ec36e30 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f2ffd700 1 -- 172.21.15.88:0/1465532087 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc011830 con 0x7f69f414fdb0 2024-09-13T18:05:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f2ffd700 1 -- 172.21.15.88:0/1465532087 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc011990 con 0x7f69f414fdb0 2024-09-13T18:05:49.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.188+0000 7f69f2ffd700 1 -- 172.21.15.88:0/1465532087 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc011d40 con 0x7f69f414fdb0 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- 172.21.15.88:0/1465532087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 msgr2=0x7f69f4159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/1465532087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f4159100 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009850 tx=0x7f69dc009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- 172.21.15.88:0/1465532087 shutdown_connections 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/1465532087 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f4159100 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- 172.21.15.88:0/1465532087 >> 172.21.15.88:0/1465532087 conn(0x7f69f40ca720 msgr2=0x7f69f40cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- 172.21.15.88:0/1465532087 shutdown_connections 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- 172.21.15.88:0/1465532087 wait complete. 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 Processor -- start 2024-09-13T18:05:49.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- start start 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69f4071720 0x7f69f4140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69f4156530 0x7f69f406e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c43c0 con 0x7f69f414fdb0 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f41ec2c0 con 0x7f69f4156530 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f8dbc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c2890 con 0x7f69f4071720 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51144/0 (socket says 172.21.15.88:51144) 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f37fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69f4071720 0x7f69f4140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 -- 172.21.15.88:0/2686851086 learned_addr learned my addr 172.21.15.88:0/2686851086 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69f3fff700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69f4156530 0x7f69f406e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 -- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69f4071720 msgr2=0x7f69f4140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69f4071720 0x7f69f4140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 -- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69f4156530 msgr2=0x7f69f406e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69f4156530 0x7f69f406e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.192+0000 7f69ebfff700 1 -- 172.21.15.88:0/2686851086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0094b0 con 0x7f69f414fdb0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69ebfff700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c500 tx=0x7f69e400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40052d0 con 0x7f69f414fdb0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4005430 con 0x7f69f414fdb0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f41ec4d0 con 0x7f69f414fdb0 2024-09-13T18:05:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40055a0 con 0x7f69f414fdb0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f41eca90 con 0x7f69f414fdb0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f4150190 con 0x7f69f414fdb0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f69e40038e0 con 0x7f69f414fdb0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 0x7f69d4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69e4083530 con 0x7f69f414fdb0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.196+0000 7f69f37fe700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 0x7f69d4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.200+0000 7f69f37fe700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 0x7f69d4068bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0090b0 tx=0x7f69dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.204+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69e4050810 con 0x7f69f414fdb0 2024-09-13T18:05:49.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.408+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69f4149d80 con 0x7f69f414fdb0 2024-09-13T18:05:49.413 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.408+0000 7f69f0ff9700 1 -- 172.21.15.88:0/2686851086 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f69e4053e30 con 0x7f69f414fdb0 2024-09-13T18:05:49.414 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:05:49.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 msgr2=0x7f69d4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 0x7f69d4068bf0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0090b0 tx=0x7f69dc008030 comp rx=0 tx=0).stop 2024-09-13T18:05:49.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 msgr2=0x7f69f406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:49.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c500 tx=0x7f69e400c810 comp rx=0 tx=0).stop 2024-09-13T18:05:49.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 shutdown_connections 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f69d4066730 0x7f69d4068bf0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69f4156530 0x7f69f406e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69f414fdb0 0x7f69f406e210 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 --2- 172.21.15.88:0/2686851086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69f4071720 0x7f69f4140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 >> 172.21.15.88:0/2686851086 conn(0x7f69f40ca720 msgr2=0x7f69f4145810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 shutdown_connections 2024-09-13T18:05:49.417 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:49.412+0000 7f69f8dbc700 1 -- 172.21.15.88:0/2686851086 wait complete. 2024-09-13T18:05:49.428 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:05:49.428 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:05:49.428 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2024-09-13T18:05:49.428 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:05:49.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:49.429 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:05:49.429 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:05:49.429 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:05:49.429 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:05:49.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.429 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:05:49.437 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42576sec preferred_lft 42576sec 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 02:42:c6:14:f3:12 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-13T18:05:49.438 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:05:49.439 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:05:49.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:05:49.439 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T18:05:49.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.484 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:05:49.492 INFO:teuthology.orchestra.run.smithi088.stdout:1 2024-09-13T18:05:49.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.494 DEBUG:teuthology.orchestra.run.smithi088:> route 2024-09-13T18:05:49.518 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2024-09-13T18:05:49.518 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:05:49.518 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-13T18:05:49.518 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:05:49.519 INFO:teuthology.orchestra.run.smithi088.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-13T18:05:49.519 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2024-09-13T18:05:49.519 INFO:teuthology.orchestra.run.smithi088.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-13T18:05:49.519 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:05:49.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.519 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2024-09-13T18:05:49.519 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T18:05:49.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:05:49.519 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:05:49.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:05:49.520 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T18:05:49.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.606 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T18:05:49.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.612 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2024-09-13T18:05:49.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.618 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2024-09-13T18:05:49.618 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T18:05:49.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:05:49.618 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:05:49.618 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T18:05:49.647 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:05:49.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:05:49.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:05:49.648 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T18:05:49.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.761 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2024-09-13T18:05:49.761 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2024-09-13T18:05:49.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2024-09-13T18:05:49.761 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:05:49.761 DEBUG:teuthology.orchestra.run.smithi088:> ') 2024-09-13T18:05:49.787 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-13T18:05:49.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:05:49.787 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:49.792 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:05:49.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:05:49.792 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:49.799 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-13T18:05:49.816 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:05:49.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:05:49.831 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:05:49.832 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:05:49.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.832 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-13T18:05:49.837 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-13T18:05:49.837 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-13T18:05:49.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-13T18:05:49.853 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:05:49.853 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:05:49.909 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:05:49.910 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:05:49.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:49.910 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-13T18:05:49.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:2024-09-13T18:05:49.924+0000 7f40c2ce4640 -1 init, newargv = 0x56190f118ad0 newargc=15 2024-09-13T18:05:49.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[32606]: starting ceph client 2024-09-13T18:05:49.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[32606]: starting fuse 2024-09-13T18:05:51.016 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2024-09-13T18:05:51.033 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-13T18:05:51.034 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-09-13T18:05:51.090 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-09-13T18:05:51.091 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-09-13T18:05:51.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:51.091 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2024-09-13T18:05:51.099 INFO:teuthology.orchestra.run.smithi088.stdout:52 2024-09-13T18:05:51.099 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [52] 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> import re 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> import os 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-13T18:05:51.100 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> return f 2024-09-13T18:05:51.101 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-13T18:05:51.102 DEBUG:teuthology.orchestra.run.smithi088:> 2024-09-13T18:05:51.102 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.0")) 2024-09-13T18:05:51.102 DEBUG:teuthology.orchestra.run.smithi088:> ' 2024-09-13T18:05:51.182 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.0.32606.asok 2024-09-13T18:05:51.369 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32606.asok 2024-09-13T18:05:51.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:51.370 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32606.asok status 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3", 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.2.4-860-g6c6b083f (6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3) reef (stable)", 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "0", 2024-09-13T18:05:51.516 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "32606", 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4755, 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4755 2024-09-13T18:05:51.517 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 362331149 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:51.518 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:0", 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 362331149 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4755 172.21.15.88:0/362331149", 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "172.21.15.88:0/362331149", 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2024-09-13T18:05:51.519 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 12, 2024-09-13T18:05:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 20, 2024-09-13T18:05:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2024-09-13T18:05:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2024-09-13T18:05:51.520 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2024-09-13T18:05:51.520 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:51.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:51.526 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2024-09-13T18:05:51.526 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:51.535 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2024-09-13T18:05:51.535 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:51.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:05:51.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:51.560 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-13T18:05:51.574 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-13T18:05:51.575 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:51.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 Processor -- start 2024-09-13T18:05:51.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 -- start start 2024-09-13T18:05:51.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e014f6d0 0x7fc8e006b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8e00c3740 0x7fc8e00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00c2750 con 0x7fc8e0155f60 2024-09-13T18:05:51.693 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00c4110 con 0x7fc8e00c3740 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8e524d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e006c090 con 0x7fc8e014f6d0 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8e00c3740 0x7fc8e00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8e00c3740 0x7fc8e00c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43852/0 (socket says 172.21.15.88:43852) 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 -- 172.21.15.88:0/1379890391 learned_addr learned my addr 172.21.15.88:0/1379890391 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8ded9d700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e014f6d0 0x7fc8e006b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 -- 172.21.15.88:0/1379890391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e014f6d0 msgr2=0x7fc8e006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e014f6d0 0x7fc8e006b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 -- 172.21.15.88:0/1379890391 >> v1:172.21.15.94:6789/0 conn(0x7fc8e0155f60 legacy=0x7fc8e006eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 -- 172.21.15.88:0/1379890391 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00c2980 con 0x7fc8e00c3740 2024-09-13T18:05:51.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8df59e700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e00c3740 0x7fc8e00c3bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009910 tx=0x7fc8d8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4cfa2990475418 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:51.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8ddd9b700 1 -- 172.21.15.88:0/1379890391 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800ba60 con 0x7fc8e00c3740 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8ddd9b700 1 -- 172.21.15.88:0/1379890391 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800bbc0 con 0x7fc8e00c3740 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.688+0000 7fc8ddd9b700 1 -- 172.21.15.88:0/1379890391 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8009e60 con 0x7fc8e00c3740 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- 172.21.15.88:0/1379890391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e00c3740 msgr2=0x7fc8e00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e00c3740 0x7fc8e00c3bd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009910 tx=0x7fc8d8009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- 172.21.15.88:0/1379890391 shutdown_connections 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e00c3740 0x7fc8e00c3bd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1379890391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e014f6d0 0x7fc8e006b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- 172.21.15.88:0/1379890391 >> 172.21.15.88:0/1379890391 conn(0x7fc8e00ca790 msgr2=0x7fc8e00caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- 172.21.15.88:0/1379890391 shutdown_connections 2024-09-13T18:05:51.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- 172.21.15.88:0/1379890391 wait complete. 2024-09-13T18:05:51.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 Processor -- start 2024-09-13T18:05:51.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- start start 2024-09-13T18:05:51.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 0x7fc8e01f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e0155f60 0x7fc8e01431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.699 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0149370 con 0x7fc8e014f6d0 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0149650 con 0x7fc8e00c3740 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8e524d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0149930 con 0x7fc8e0155f60 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8ded9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8ded9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:50202/0 (socket says 172.21.15.88:50202) 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8ded9d700 1 -- 172.21.15.88:0/1567190738 learned_addr learned my addr 172.21.15.88:0/1567190738 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8de59c700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 0x7fc8e01f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.692+0000 7fc8df59e700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e0155f60 0x7fc8e01431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 -- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e0155f60 msgr2=0x7fc8e01431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e0155f60 0x7fc8e01431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 -- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 msgr2=0x7fc8e01efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 -- 172.21.15.88:0/1567190738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009570 con 0x7fc8e014f6d0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8ded9d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8de59c700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 0x7fc8e01f02a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8e006e610 tx=0x7fc8c800cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8003c20 con 0x7fc8e014f6d0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8003d80 con 0x7fc8e014f6d0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c800aa20 con 0x7fc8e014f6d0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e0149c10 con 0x7fc8e014f6d0 2024-09-13T18:05:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e014a1d0 con 0x7fc8e014f6d0 2024-09-13T18:05:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0072470 con 0x7fc8e014f6d0 2024-09-13T18:05:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.696+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc8c800ab80 con 0x7fc8e014f6d0 2024-09-13T18:05:51.702 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.700+0000 7fc8d77fe700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.700+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8c80840b0 con 0x7fc8e014f6d0 2024-09-13T18:05:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.700+0000 7fc8ded9d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:51.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.700+0000 7fc8ded9d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 0x7fc8c4068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009ea0 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:51.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.708+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc8c8051390 con 0x7fc8e014f6d0 2024-09-13T18:05:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.884+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8e00c48e0 con 0x7fc8e014f6d0 2024-09-13T18:05:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.888+0000 7fc8d77fe700 1 -- 172.21.15.88:0/1567190738 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7fc8c80549b0 con 0x7fc8e014f6d0 2024-09-13T18:05:51.893 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:51.893 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 msgr2=0x7fc8c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 0x7fc8c4068bf0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0009ea0 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 msgr2=0x7fc8e01f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 0x7fc8e01f02a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc8e006e610 tx=0x7fc8c800cdf0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 shutdown_connections 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc8c4066730 0x7fc8c4068bf0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e0155f60 0x7fc8e01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8e014f6d0 0x7fc8e01f02a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 --2- 172.21.15.88:0/1567190738 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e00c3740 0x7fc8e01efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 >> 172.21.15.88:0/1567190738 conn(0x7fc8e00ca790 msgr2=0x7fc8e006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 shutdown_connections 2024-09-13T18:05:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:51.892+0000 7fc8e524d700 1 -- 172.21.15.88:0/1567190738 wait complete. 2024-09-13T18:05:51.909 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:51.909 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.024+0000 7fdacffff700 1 Processor -- start 2024-09-13T18:05:52.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.024+0000 7fdacffff700 1 -- start start 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdad0150010 0x7fdad00c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 0x7fdad00c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad0159290 con 0x7fdad00b1160 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad0159f10 con 0x7fdad0150010 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad0159080 con 0x7fdad0156440 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdad0150010 0x7fdad00c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdad0150010 0x7fdad00c6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43868/0 (socket says 172.21.15.88:43868) 2024-09-13T18:05:52.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 -- 172.21.15.88:0/1353714672 learned_addr learned my addr 172.21.15.88:0/1353714672 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacf7fe700 1 --2- 172.21.15.88:0/1353714672 >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 0x7fdad00c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 -- 172.21.15.88:0/1353714672 >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 msgr2=0x7fdad00c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 --2- 172.21.15.88:0/1353714672 >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 0x7fdad00c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 -- 172.21.15.88:0/1353714672 >> v1:172.21.15.88:6789/0 conn(0x7fdad00b1160 legacy=0x7fdad0155d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 -- 172.21.15.88:0/1353714672 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad0159570 con 0x7fdad0150010 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacf7fe700 1 --2- 172.21.15.88:0/1353714672 >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 0x7fdad00c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdaceffd700 1 --2- 172.21.15.88:0/1353714672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0150010 0x7fdad00c6a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdad006ce80 tx=0x7fdac0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9271b54004a08642 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdace7fc700 1 -- 172.21.15.88:0/1353714672 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000b8a0 con 0x7fdad0150010 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdace7fc700 1 -- 172.21.15.88:0/1353714672 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000ba00 con 0x7fdad0150010 2024-09-13T18:05:52.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdace7fc700 1 -- 172.21.15.88:0/1353714672 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac000bd90 con 0x7fdad0150010 2024-09-13T18:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- 172.21.15.88:0/1353714672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0150010 msgr2=0x7fdad00c6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 --2- 172.21.15.88:0/1353714672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0150010 0x7fdad00c6a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdad006ce80 tx=0x7fdac0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- 172.21.15.88:0/1353714672 shutdown_connections 2024-09-13T18:05:52.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 --2- 172.21.15.88:0/1353714672 >> v2:172.21.15.94:3300/0 conn(0x7fdad0156440 0x7fdad00c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 --2- 172.21.15.88:0/1353714672 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0150010 0x7fdad00c6a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- 172.21.15.88:0/1353714672 >> 172.21.15.88:0/1353714672 conn(0x7fdad00cb670 msgr2=0x7fdad00c7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- 172.21.15.88:0/1353714672 shutdown_connections 2024-09-13T18:05:52.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.028+0000 7fdacffff700 1 -- 172.21.15.88:0/1353714672 wait complete. 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 Processor -- start 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 -- start start 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdad00b1160 0x7fdad00c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdad0150010 0x7fdad0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad006f7a0 con 0x7fdad0156440 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad01f2970 con 0x7fdad00b1160 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad01539d0 con 0x7fdad0150010 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43876/0 (socket says 172.21.15.88:43876) 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 -- 172.21.15.88:0/2975323737 learned_addr learned my addr 172.21.15.88:0/2975323737 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdaceffd700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdad00b1160 0x7fdad00c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdac7fff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdad0150010 0x7fdad0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 -- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdad0150010 msgr2=0x7fdad0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdad0150010 0x7fdad0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 -- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdad00b1160 msgr2=0x7fdad00c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdad00b1160 0x7fdad00c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 -- 172.21.15.88:0/2975323737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0009570 con 0x7fdad0156440 2024-09-13T18:05:52.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.032+0000 7fdacf7fe700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdac8007f20 tx=0x7fdac800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800dd80 con 0x7fdad0156440 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800f040 con 0x7fdad0156440 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad01f1da0 con 0x7fdad0156440 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800dee0 con 0x7fdad0156440 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad01f2320 con 0x7fdad0156440 2024-09-13T18:05:52.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad01f2b20 con 0x7fdad0156440 2024-09-13T18:05:52.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdac8003c80 con 0x7fdad0156440 2024-09-13T18:05:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 0x7fdab0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdac8084520 con 0x7fdad0156440 2024-09-13T18:05:52.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.036+0000 7fdaceffd700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 0x7fdab0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.040+0000 7fdaceffd700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 0x7fdab0068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdac0000c00 tx=0x7fdac0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.044+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdac8051860 con 0x7fdad0156440 2024-09-13T18:05:52.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.208+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdad01f2b20 con 0x7fdad0156440 2024-09-13T18:05:52.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.208+0000 7fdac77fe700 1 -- 172.21.15.88:0/2975323737 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdad01f2b20 con 0x7fdad0156440 2024-09-13T18:05:52.213 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 msgr2=0x7fdab0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 0x7fdab0068bf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdac0000c00 tx=0x7fdac0008030 comp rx=0 tx=0).stop 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 msgr2=0x7fdad00afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdac8007f20 tx=0x7fdac800d3b0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 shutdown_connections 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdab0066730 0x7fdab0068bf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdad0150010 0x7fdad0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdad0156440 0x7fdad00afd20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 --2- 172.21.15.88:0/2975323737 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdad00b1160 0x7fdad00c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 >> 172.21.15.88:0/2975323737 conn(0x7fdad00cb670 msgr2=0x7fdad0152790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 shutdown_connections 2024-09-13T18:05:52.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.212+0000 7fdacffff700 1 -- 172.21.15.88:0/2975323737 wait complete. 2024-09-13T18:05:52.228 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:05:52.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.344+0000 7fd6925cd700 1 Processor -- start 2024-09-13T18:05:52.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.344+0000 7fd6925cd700 1 -- start start 2024-09-13T18:05:52.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd68c153330 0x7fd68c0c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd68c0ca6b0 0x7fd68c06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c15a0b0 con 0x7fd68c06f3e0 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c1590e0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0cafd0 con 0x7fd68c153330 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd68c0ca6b0 0x7fd68c06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd691dcc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd68c06f3e0 0x7fd68c0cb410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46928/0 (socket says 172.21.15.88:46928) 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd691dcc700 1 -- 172.21.15.88:0/3738688874 learned_addr learned my addr 172.21.15.88:0/3738688874 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:52.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6915cb700 1 --2- 172.21.15.88:0/3738688874 >> v2:172.21.15.94:3300/0 conn(0x7fd68c153330 0x7fd68c0c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd683fff700 1 -- 172.21.15.88:0/3738688874 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202474964 0 0) 0x7fd68c15a0b0 con 0x7fd68c06f3e0 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd683fff700 1 -- 172.21.15.88:0/3738688874 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6780035d0 con 0x7fd68c06f3e0 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 -- 172.21.15.88:0/3738688874 >> v2:172.21.15.94:3300/0 conn(0x7fd68c153330 msgr2=0x7fd68c0c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 --2- 172.21.15.88:0/3738688874 >> v2:172.21.15.94:3300/0 conn(0x7fd68c153330 0x7fd68c0c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 -- 172.21.15.88:0/3738688874 >> v1:172.21.15.88:6789/0 conn(0x7fd68c06f3e0 legacy=0x7fd68c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 -- 172.21.15.88:0/3738688874 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c1592f0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd690dca700 1 --2- 172.21.15.88:0/3738688874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c06eea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0cbfa0 tx=0x7fd688009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63df4f44a41ea5fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd683fff700 1 -- 172.21.15.88:0/3738688874 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011830 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd683fff700 1 -- 172.21.15.88:0/3738688874 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688011990 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd683fff700 1 -- 172.21.15.88:0/3738688874 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688011d20 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- 172.21.15.88:0/3738688874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 msgr2=0x7fd68c06eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 --2- 172.21.15.88:0/3738688874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c06eea0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0cbfa0 tx=0x7fd688009b30 comp rx=0 tx=0).stop 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- 172.21.15.88:0/3738688874 shutdown_connections 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 --2- 172.21.15.88:0/3738688874 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c06eea0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 --2- 172.21.15.88:0/3738688874 >> v2:172.21.15.94:3300/0 conn(0x7fd68c153330 0x7fd68c0c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- 172.21.15.88:0/3738688874 >> 172.21.15.88:0/3738688874 conn(0x7fd68c071c30 msgr2=0x7fd68c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- 172.21.15.88:0/3738688874 shutdown_connections 2024-09-13T18:05:52.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.348+0000 7fd6925cd700 1 -- 172.21.15.88:0/3738688874 wait complete. 2024-09-13T18:05:52.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 Processor -- start 2024-09-13T18:05:52.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- start start 2024-09-13T18:05:52.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 0x7fd68c1ef620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68c153330 0x7fd68c0ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c0cc7e0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c14d7c0 con 0x7fd68c153330 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1efb60 con 0x7fd68c06f3e0 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43898/0 (socket says 172.21.15.88:43898) 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 -- 172.21.15.88:0/2059308013 learned_addr learned my addr 172.21.15.88:0/2059308013 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd691dcc700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68c153330 0x7fd68c0ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6915cb700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 0x7fd68c1ef620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 -- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 msgr2=0x7fd68c1ef620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 0x7fd68c1ef620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 -- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68c153330 msgr2=0x7fd68c0ccef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68c153330 0x7fd68c0ccef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 -- 172.21.15.88:0/2059308013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6880094b0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6915cb700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 0x7fd68c1ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd690dca700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6880090b0 tx=0x7fd688004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688004400 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68801f070 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c0cdd70 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6880036c0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.352+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c0cdff0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c153710 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd688021030 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd681ffb700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 0x7fd670068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd688085390 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.361 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd6915cb700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 0x7fd670068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.356+0000 7fd6915cb700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 0x7fd670068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009ba0 tx=0x7fd67c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.364+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd688052790 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.537 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.532+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd68c0b2a50 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.532+0000 7fd681ffb700 1 -- 172.21.15.88:0/2059308013 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd688055db0 con 0x7fd68c0ca6b0 2024-09-13T18:05:52.538 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:05:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 msgr2=0x7fd670068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 0x7fd670068bf0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd67c009ba0 tx=0x7fd67c008040 comp rx=0 tx=0).stop 2024-09-13T18:05:52.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 msgr2=0x7fd68c1474b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6880090b0 tx=0x7fd688004770 comp rx=0 tx=0).stop 2024-09-13T18:05:52.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 shutdown_connections 2024-09-13T18:05:52.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd670066730 0x7fd670068bf0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd68c153330 0x7fd68c0ccef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd68c0ca6b0 0x7fd68c1474b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 --2- 172.21.15.88:0/2059308013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd68c06f3e0 0x7fd68c1ef620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 >> 172.21.15.88:0/2059308013 conn(0x7fd68c071c30 msgr2=0x7fd68c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 shutdown_connections 2024-09-13T18:05:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.536+0000 7fd6925cd700 1 -- 172.21.15.88:0/2059308013 wait complete. 2024-09-13T18:05:52.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:05:52.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.660+0000 7f80be989700 1 Processor -- start 2024-09-13T18:05:52.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.660+0000 7f80be989700 1 -- start start 2024-09-13T18:05:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f80b8150c10 0x7f80b8156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b806e6f0 con 0x7f80b80c45a0 2024-09-13T18:05:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b80c4180 con 0x7f80b8150c10 2024-09-13T18:05:52.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80c6cb0 con 0x7f80b80c9240 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f80b8150c10 0x7f80b8156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be188700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be188700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:40990/0 (socket says 172.21.15.88:40990) 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f80b8150c10 0x7f80b8156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:50246/0 (socket says 172.21.15.88:50246) 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be188700 1 -- 172.21.15.88:0/4131631695 learned_addr learned my addr 172.21.15.88:0/4131631695 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd186700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f80b80c45a0 0x7f80b806dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45248/0 (socket says 172.21.15.88:45248) 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 -- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 msgr2=0x7f80b80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:52.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 -- 172.21.15.88:0/4131631695 >> v1:172.21.15.94:6789/0 conn(0x7f80b80c45a0 legacy=0x7f80b806dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 -- 172.21.15.88:0/4131631695 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c3de0 con 0x7f80b8150c10 2024-09-13T18:05:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be188700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:52.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bd987700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b8150c10 0x7f80b8156cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52bc6f31d76015eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bc985700 1 -- 172.21.15.88:0/4131631695 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b000e070 con 0x7f80b8150c10 2024-09-13T18:05:52.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bc985700 1 -- 172.21.15.88:0/4131631695 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b000bb20 con 0x7f80b8150c10 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80bc985700 1 -- 172.21.15.88:0/4131631695 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0012430 con 0x7f80b8150c10 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b8150c10 msgr2=0x7f80b8156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b8150c10 0x7f80b8156cb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- 172.21.15.88:0/4131631695 shutdown_connections 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c9240 0x7f80b80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 --2- 172.21.15.88:0/4131631695 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b8150c10 0x7f80b8156cb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- 172.21.15.88:0/4131631695 >> 172.21.15.88:0/4131631695 conn(0x7f80b8066090 msgr2=0x7f80b80664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- 172.21.15.88:0/4131631695 shutdown_connections 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.664+0000 7f80be989700 1 -- 172.21.15.88:0/4131631695 wait complete. 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 Processor -- start 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- start start 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c45a0 0x7f80b814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 0x7f80b8146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80cb810 con 0x7f80b8150c10 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b80cc390 con 0x7f80b80c9240 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b8070fe0 con 0x7f80b80c45a0 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 0x7f80b8146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80bd186700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80bd186700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:50254/0 (socket says 172.21.15.88:50254) 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80bd987700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c45a0 0x7f80b814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80bd186700 1 -- 172.21.15.88:0/3822580412 learned_addr learned my addr 172.21.15.88:0/3822580412 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 -- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c45a0 msgr2=0x7f80b814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c45a0 0x7f80b814b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 -- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 msgr2=0x7f80b814eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 -- 172.21.15.88:0/3822580412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009570 con 0x7f80b8150c10 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80bd186700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be188700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 0x7f80b8146380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e930 tx=0x7f80b400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4013680 con 0x7f80b8150c10 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4013800 con 0x7f80b8150c10 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b0009a70 con 0x7f80b8150c10 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4013bb0 con 0x7f80b8150c10 2024-09-13T18:05:52.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.668+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b80cbd40 con 0x7f80b8150c10 2024-09-13T18:05:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.672+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b80cc500 con 0x7f80b8150c10 2024-09-13T18:05:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.672+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f80b4013d10 con 0x7f80b8150c10 2024-09-13T18:05:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.672+0000 7f80ae7fc700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 0x7f809c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.672+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80b4084080 con 0x7f80b8150c10 2024-09-13T18:05:52.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.672+0000 7f80bd987700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 0x7f809c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.676+0000 7f80bd987700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 0x7f809c068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80b0014040 tx=0x7f80b0011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.680+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f80b4051480 con 0x7f80b8150c10 2024-09-13T18:05:52.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.848+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f80b8150ff0 con 0x7f80b8150c10 2024-09-13T18:05:52.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.848+0000 7f80ae7fc700 1 -- 172.21.15.88:0/3822580412 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f80b4054aa0 con 0x7f80b8150c10 2024-09-13T18:05:52.855 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 msgr2=0x7f809c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 0x7f809c068bf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80b0014040 tx=0x7f80b0011000 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 msgr2=0x7f80b8146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 0x7f80b8146380 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f80b400e930 tx=0x7f80b400ec40 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 shutdown_connections 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f809c066730 0x7f809c068bf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80b8150c10 0x7f80b8146380 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f80b80c9240 0x7f80b814eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 --2- 172.21.15.88:0/3822580412 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f80b80c45a0 0x7f80b814b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 >> 172.21.15.88:0/3822580412 conn(0x7f80b8066090 msgr2=0x7f80b80c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 shutdown_connections 2024-09-13T18:05:52.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.852+0000 7f80be989700 1 -- 172.21.15.88:0/3822580412 wait complete. 2024-09-13T18:05:52.869 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-13T18:05:52.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:52.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 Processor -- start 2024-09-13T18:05:52.981 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 -- start start 2024-09-13T18:05:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 0x7fef8c06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fef8c0c3e30 0x7fef8c0c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8c06dce0 con 0x7fef8c150b30 2024-09-13T18:05:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c06e010 con 0x7fef8c0c3e30 2024-09-13T18:05:52.982 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.976+0000 7fef8bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c06d140 con 0x7fef8c06f6a0 2024-09-13T18:05:52.983 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 0x7fef8c06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8affd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fef8c150b30 0x7fef8c06e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45250/0 (socket says 172.21.15.88:45250) 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8affd700 1 -- 172.21.15.88:0/1062637170 learned_addr learned my addr 172.21.15.88:0/1062637170 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8b7fe700 1 --2- 172.21.15.88:0/1062637170 >> v2:172.21.15.94:3300/0 conn(0x7fef8c0c3e30 0x7fef8c0c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 -- 172.21.15.88:0/1062637170 >> v2:172.21.15.94:3300/0 conn(0x7fef8c0c3e30 msgr2=0x7fef8c0c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 --2- 172.21.15.88:0/1062637170 >> v2:172.21.15.94:3300/0 conn(0x7fef8c0c3e30 0x7fef8c0c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 -- 172.21.15.88:0/1062637170 >> v1:172.21.15.94:6789/0 conn(0x7fef8c150b30 legacy=0x7fef8c06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 -- 172.21.15.88:0/1062637170 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c06bcb0 con 0x7fef8c06f6a0 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8a7fc700 1 --2- 172.21.15.88:0/1062637170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 0x7fef8c06fae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef74009d90 tx=0x7fef7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=856dec37d1a902f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.984 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef89ffb700 1 -- 172.21.15.88:0/1062637170 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7400e070 con 0x7fef8c06f6a0 2024-09-13T18:05:52.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef89ffb700 1 -- 172.21.15.88:0/1062637170 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7400bb20 con 0x7fef8c06f6a0 2024-09-13T18:05:52.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef89ffb700 1 -- 172.21.15.88:0/1062637170 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74012430 con 0x7fef8c06f6a0 2024-09-13T18:05:52.985 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 -- 172.21.15.88:0/1062637170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 msgr2=0x7fef8c06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 --2- 172.21.15.88:0/1062637170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 0x7fef8c06fae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef74009d90 tx=0x7fef7400b330 comp rx=0 tx=0).stop 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 -- 172.21.15.88:0/1062637170 shutdown_connections 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 --2- 172.21.15.88:0/1062637170 >> v2:172.21.15.94:3300/0 conn(0x7fef8c0c3e30 0x7fef8c0c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 --2- 172.21.15.88:0/1062637170 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c06f6a0 0x7fef8c06fae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 -- 172.21.15.88:0/1062637170 >> 172.21.15.88:0/1062637170 conn(0x7fef8c0ca720 msgr2=0x7fef8c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:52.986 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 -- 172.21.15.88:0/1062637170 shutdown_connections 2024-09-13T18:05:52.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.980+0000 7fef8bfff700 1 -- 172.21.15.88:0/1062637170 wait complete. 2024-09-13T18:05:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 Processor -- start 2024-09-13T18:05:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- start start 2024-09-13T18:05:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c06f6a0 0x7fef8c1ed160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c150b30 0x7fef8c146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c154860 con 0x7fef8c0c3e30 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c145ca0 con 0x7fef8c06f6a0 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c154ab0 con 0x7fef8c150b30 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43914/0 (socket says 172.21.15.88:43914) 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 -- 172.21.15.88:0/2372353642 learned_addr learned my addr 172.21.15.88:0/2372353642 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8affd700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c06f6a0 0x7fef8c1ed160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8b7fe700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c150b30 0x7fef8c146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 -- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c150b30 msgr2=0x7fef8c146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c150b30 0x7fef8c146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 -- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c06f6a0 msgr2=0x7fef8c1ed160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c06f6a0 0x7fef8c1ed160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 -- 172.21.15.88:0/2372353642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef74009a70 con 0x7fef8c0c3e30 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8a7fc700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef74014040 tx=0x7fef74004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74012430 con 0x7fef8c0c3e30 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74020070 con 0x7fef8c0c3e30 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c154d90 con 0x7fef8c0c3e30 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74004280 con 0x7fef8c0c3e30 2024-09-13T18:05:52.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c156ea0 con 0x7fef8c0c3e30 2024-09-13T18:05:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.984+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c146180 con 0x7fef8c0c3e30 2024-09-13T18:05:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.988+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fef740043e0 con 0x7fef8c0c3e30 2024-09-13T18:05:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.988+0000 7fef837fe700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 0x7fef6c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:52.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.988+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef74022070 con 0x7fef8c0c3e30 2024-09-13T18:05:52.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.988+0000 7fef8affd700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 0x7fef6c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:52.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.988+0000 7fef8affd700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 0x7fef6c068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef7c000f60 tx=0x7fef7c007f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:52.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:52.992+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fef740b7db0 con 0x7fef8c0c3e30 2024-09-13T18:05:53.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.160+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef8c06c530 con 0x7fef6c066760 2024-09-13T18:05:53.182 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.176+0000 7fef837fe700 1 -- 172.21.15.88:0/2372353642 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264705 (secure 0 0 0) 0x7fef7c004b90 con 0x7fef6c066760 2024-09-13T18:05:53.186 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:53.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 msgr2=0x7fef6c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 0x7fef6c068c20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fef7c000f60 tx=0x7fef7c007f30 comp rx=0 tx=0).stop 2024-09-13T18:05:53.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 msgr2=0x7fef8c156960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fef74014040 tx=0x7fef74004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 shutdown_connections 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fef6c066760 0x7fef6c068c20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fef8c150b30 0x7fef8c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fef8c0c3e30 0x7fef8c156960 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 --2- 172.21.15.88:0/2372353642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fef8c06f6a0 0x7fef8c1ed160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 >> 172.21.15.88:0/2372353642 conn(0x7fef8c0ca720 msgr2=0x7fef8c0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 shutdown_connections 2024-09-13T18:05:53.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.184+0000 7fef8bfff700 1 -- 172.21.15.88:0/2372353642 wait complete. 2024-09-13T18:05:53.191 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:53.204 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-13T18:05:52.961536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595888,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":285,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238464,"kb_used_data":1856,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":1900544,"data_stored":1744550,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1800,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.525454+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:36.525454+0000","last_peered":"2024-09-13T18:05:36.525454+0000","last_clean":"2024-09-13T18:05:36.525454+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:36.525454+0000","last_undegraded":"2024-09-13T18:05:36.525454+0000","last_fullsized":"2024-09-13T18:05:36.525454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1016,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.553505+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:42.553505+0000","last_peered":"2024-09-13T18:05:42.553505+0000","last_clean":"2024-09-13T18:05:42.553505+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:42.553505+0000","last_undegraded":"2024-09-13T18:05:42.553505+0000","last_fullsized":"2024-09-13T18:05:42.553505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.553024+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:42.553024+0000","last_peered":"2024-09-13T18:05:42.553024+0000","last_clean":"2024-09-13T18:05:42.553024+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:42.553024+0000","last_undegraded":"2024-09-13T18:05:42.553024+0000","last_fullsized":"2024-09-13T18:05:42.553024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044702+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:28.044702+0000","last_peered":"2024-09-13T18:05:28.044702+0000","last_clean":"2024-09-13T18:05:28.044702+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:28.044702+0000","last_undegraded":"2024-09-13T18:05:28.044702+0000","last_fullsized":"2024-09-13T18:05:28.044702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516853+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:36.516853+0000","last_peered":"2024-09-13T18:05:36.516853+0000","last_clean":"2024-09-13T18:05:36.516853+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:36.516853+0000","last_undegraded":"2024-09-13T18:05:36.516853+0000","last_fullsized":"2024-09-13T18:05:36.516853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516088+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:36.516088+0000","last_peered":"2024-09-13T18:05:36.516088+0000","last_clean":"2024-09-13T18:05:36.516088+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:36.516088+0000","last_undegraded":"2024-09-13T18:05:36.516088+0000","last_fullsized":"2024-09-13T18:05:36.516088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488549+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:31.488549+0000","last_peered":"2024-09-13T18:05:31.488549+0000","last_clean":"2024-09-13T18:05:31.488549+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:31.488549+0000","last_undegraded":"2024-09-13T18:05:31.488549+0000","last_fullsized":"2024-09-13T18:05:31.488549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518973+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:36.518973+0000","last_peered":"2024-09-13T18:05:36.518973+0000","last_clean":"2024-09-13T18:05:36.518973+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:36.518973+0000","last_undegraded":"2024-09-13T18:05:36.518973+0000","last_fullsized":"2024-09-13T18:05:36.518973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.554679+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:42.554679+0000","last_peered":"2024-09-13T18:05:42.554679+0000","last_clean":"2024-09-13T18:05:42.554679+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:42.554679+0000","last_undegraded":"2024-09-13T18:05:42.554679+0000","last_fullsized":"2024-09-13T18:05:42.554679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521855+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:36.521855+0000","last_peered":"2024-09-13T18:05:36.521855+0000","last_clean":"2024-09-13T18:05:36.521855+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:36.521855+0000","last_undegraded":"2024-09-13T18:05:36.521855+0000","last_fullsized":"2024-09-13T18:05:36.521855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.554412+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:42.554412+0000","last_peered":"2024-09-13T18:05:42.554412+0000","last_clean":"2024-09-13T18:05:42.554412+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:42.554412+0000","last_undegraded":"2024-09-13T18:05:42.554412+0000","last_fullsized":"2024-09-13T18:05:42.554412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'15","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556321+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:42.556321+0000","last_peered":"2024-09-13T18:05:42.556321+0000","last_clean":"2024-09-13T18:05:42.556321+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:42.556321+0000","last_undegraded":"2024-09-13T18:05:42.556321+0000","last_fullsized":"2024-09-13T18:05:42.556321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.485788+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:31.485788+0000","last_peered":"2024-09-13T18:05:31.485788+0000","last_clean":"2024-09-13T18:05:31.485788+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:31.485788+0000","last_undegraded":"2024-09-13T18:05:31.485788+0000","last_fullsized":"2024-09-13T18:05:31.485788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.487627+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:31.487627+0000","last_peered":"2024-09-13T18:05:31.487627+0000","last_clean":"2024-09-13T18:05:31.487627+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:31.487627+0000","last_undegraded":"2024-09-13T18:05:31.487627+0000","last_fullsized":"2024-09-13T18:05:31.487627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482911+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:27.482911+0000","last_peered":"2024-09-13T18:05:27.482911+0000","last_clean":"2024-09-13T18:05:27.482911+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:27.482911+0000","last_undegraded":"2024-09-13T18:05:27.482911+0000","last_fullsized":"2024-09-13T18:05:27.482911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.555354+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:42.555354+0000","last_peered":"2024-09-13T18:05:42.555354+0000","last_clean":"2024-09-13T18:05:42.555354+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:42.555354+0000","last_undegraded":"2024-09-13T18:05:42.555354+0000","last_fullsized":"2024-09-13T18:05:42.555354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519034+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:36.519034+0000","last_peered":"2024-09-13T18:05:36.519034+0000","last_clean":"2024-09-13T18:05:36.519034+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:36.519034+0000","last_undegraded":"2024-09-13T18:05:36.519034+0000","last_fullsized":"2024-09-13T18:05:36.519034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.551636+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:42.551636+0000","last_peered":"2024-09-13T18:05:42.551636+0000","last_clean":"2024-09-13T18:05:42.551636+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:42.551636+0000","last_undegraded":"2024-09-13T18:05:42.551636+0000","last_fullsized":"2024-09-13T18:05:42.551636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556085+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:42.556085+0000","last_peered":"2024-09-13T18:05:42.556085+0000","last_clean":"2024-09-13T18:05:42.556085+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:42.556085+0000","last_undegraded":"2024-09-13T18:05:42.556085+0000","last_fullsized":"2024-09-13T18:05:42.556085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044806+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:28.044806+0000","last_peered":"2024-09-13T18:05:28.044806+0000","last_clean":"2024-09-13T18:05:28.044806+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:28.044806+0000","last_undegraded":"2024-09-13T18:05:28.044806+0000","last_fullsized":"2024-09-13T18:05:28.044806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.033041+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:30.033041+0000","last_peered":"2024-09-13T18:05:30.033041+0000","last_clean":"2024-09-13T18:05:30.033041+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:30.033041+0000","last_undegraded":"2024-09-13T18:05:30.033041+0000","last_fullsized":"2024-09-13T18:05:30.033041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.555096+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:42.555096+0000","last_peered":"2024-09-13T18:05:42.555096+0000","last_clean":"2024-09-13T18:05:42.555096+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:42.555096+0000","last_undegraded":"2024-09-13T18:05:42.555096+0000","last_fullsized":"2024-09-13T18:05:42.555096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516383+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:36.516383+0000","last_peered":"2024-09-13T18:05:36.516383+0000","last_clean":"2024-09-13T18:05:36.516383+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:36.516383+0000","last_undegraded":"2024-09-13T18:05:36.516383+0000","last_fullsized":"2024-09-13T18:05:36.516383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519555+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:36.519555+0000","last_peered":"2024-09-13T18:05:36.519555+0000","last_clean":"2024-09-13T18:05:36.519555+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:36.519555+0000","last_undegraded":"2024-09-13T18:05:36.519555+0000","last_fullsized":"2024-09-13T18:05:36.519555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519873+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:36.519873+0000","last_peered":"2024-09-13T18:05:36.519873+0000","last_clean":"2024-09-13T18:05:36.519873+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:36.519873+0000","last_undegraded":"2024-09-13T18:05:36.519873+0000","last_fullsized":"2024-09-13T18:05:36.519873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482759+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:27.482759+0000","last_peered":"2024-09-13T18:05:27.482759+0000","last_clean":"2024-09-13T18:05:27.482759+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:27.482759+0000","last_undegraded":"2024-09-13T18:05:27.482759+0000","last_fullsized":"2024-09-13T18:05:27.482759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.517844+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:36.517844+0000","last_peered":"2024-09-13T18:05:36.517844+0000","last_clean":"2024-09-13T18:05:36.517844+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:36.517844+0000","last_undegraded":"2024-09-13T18:05:36.517844+0000","last_fullsized":"2024-09-13T18:05:36.517844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483826+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:31.483826+0000","last_peered":"2024-09-13T18:05:31.483826+0000","last_clean":"2024-09-13T18:05:31.483826+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:31.483826+0000","last_undegraded":"2024-09-13T18:05:31.483826+0000","last_fullsized":"2024-09-13T18:05:31.483826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.552928+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:42.552928+0000","last_peered":"2024-09-13T18:05:42.552928+0000","last_clean":"2024-09-13T18:05:42.552928+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:42.552928+0000","last_undegraded":"2024-09-13T18:05:42.552928+0000","last_fullsized":"2024-09-13T18:05:42.552928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.489018+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:31.489018+0000","last_peered":"2024-09-13T18:05:31.489018+0000","last_clean":"2024-09-13T18:05:31.489018+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:31.489018+0000","last_undegraded":"2024-09-13T18:05:31.489018+0000","last_fullsized":"2024-09-13T18:05:31.489018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556891+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:42.556891+0000","last_peered":"2024-09-13T18:05:42.556891+0000","last_clean":"2024-09-13T18:05:42.556891+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:42.556891+0000","last_undegraded":"2024-09-13T18:05:42.556891+0000","last_fullsized":"2024-09-13T18:05:42.556891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5520,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":69970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":70096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":661230,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":221184,"data_stored":71346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":217088,"data_stored":69818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":71380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":221184,"data_stored":70530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":660180,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:53.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:05:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 Processor -- start 2024-09-13T18:05:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 -- start start 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc070007110 0x7fc070007530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc070006c80 con 0x7fc0700dcf40 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0700dd320 con 0x7fc0700e60e0 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07e8c2700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc070008ab0 con 0x7fc070007110 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d8c0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc0700dcf40 0x7fc070046990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46942/0 (socket says 172.21.15.88:46942) 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d8c0700 1 -- 172.21.15.88:0/1831167037 learned_addr learned my addr 172.21.15.88:0/1831167037 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d0bf700 1 --2- 172.21.15.88:0/1831167037 >> v2:172.21.15.94:3300/0 conn(0x7fc070007110 0x7fc070007530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07c8be700 1 -- 172.21.15.88:0/1831167037 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918976571 0 0) 0x7fc070006c80 con 0x7fc0700dcf40 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07c8be700 1 -- 172.21.15.88:0/1831167037 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0640035d0 con 0x7fc0700dcf40 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d0bf700 1 -- 172.21.15.88:0/1831167037 >> v1:172.21.15.94:6789/0 conn(0x7fc0700e60e0 legacy=0x7fc0700e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d0bf700 1 -- 172.21.15.88:0/1831167037 >> v1:172.21.15.88:6789/0 conn(0x7fc0700dcf40 legacy=0x7fc070046990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d0bf700 1 -- 172.21.15.88:0/1831167037 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc070006950 con 0x7fc070007110 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07d0bf700 1 --2- 172.21.15.88:0/1831167037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc070007110 0x7fc070007530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc074009850 tx=0x7fc074009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31496d06d2360b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07c8be700 1 -- 172.21.15.88:0/1831167037 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011830 con 0x7fc070007110 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07c8be700 1 -- 172.21.15.88:0/1831167037 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074011990 con 0x7fc070007110 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.364+0000 7fc07c8be700 1 -- 172.21.15.88:0/1831167037 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074011d40 con 0x7fc070007110 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- 172.21.15.88:0/1831167037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc070007110 msgr2=0x7fc070007530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/1831167037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc070007110 0x7fc070007530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc074009850 tx=0x7fc074009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:53.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- 172.21.15.88:0/1831167037 shutdown_connections 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/1831167037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc070007110 0x7fc070007530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- 172.21.15.88:0/1831167037 >> 172.21.15.88:0/1831167037 conn(0x7fc070050e10 msgr2=0x7fc070051220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- 172.21.15.88:0/1831167037 shutdown_connections 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- 172.21.15.88:0/1831167037 wait complete. 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 Processor -- start 2024-09-13T18:05:53.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- start start 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc070007110 0x7fc0700d32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0700dcf40 0x7fc0700488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07004a970 con 0x7fc0700e60e0 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07004abc0 con 0x7fc0700dcf40 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e8c2700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07004aea0 con 0x7fc070007110 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e0c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e0c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43930/0 (socket says 172.21.15.88:43930) 2024-09-13T18:05:53.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07e0c1700 1 -- 172.21.15.88:0/829344199 learned_addr learned my addr 172.21.15.88:0/829344199 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07d0bf700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0700dcf40 0x7fc0700488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.368+0000 7fc07d8c0700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc070007110 0x7fc0700d32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 -- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc070007110 msgr2=0x7fc0700d32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc070007110 0x7fc0700d32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 -- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0700dcf40 msgr2=0x7fc0700488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0700dcf40 0x7fc0700488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 -- 172.21.15.88:0/829344199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740094b0 con 0x7fc0700e60e0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e0c1700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc078067a80 tx=0x7fc0780743b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078068400 con 0x7fc0700e60e0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc078068560 con 0x7fc0700e60e0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078067d20 con 0x7fc0700e60e0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0700dfbb0 con 0x7fc0700e60e0 2024-09-13T18:05:53.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0700e0170 con 0x7fc0700e60e0 2024-09-13T18:05:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc070033c30 con 0x7fc0700e60e0 2024-09-13T18:05:53.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.372+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc078072140 con 0x7fc0700e60e0 2024-09-13T18:05:53.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.376+0000 7fc06e7fc700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 0x7fc05c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.376+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0780fe640 con 0x7fc0700e60e0 2024-09-13T18:05:53.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.376+0000 7fc07d8c0700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 0x7fc05c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.376+0000 7fc07d8c0700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 0x7fc05c068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc068005930 tx=0x7fc068009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.380+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc0780cb920 con 0x7fc0700e60e0 2024-09-13T18:05:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.548+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc070047590 con 0x7fc05c066730 2024-09-13T18:05:53.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.564+0000 7fc06e7fc700 1 -- 172.21.15.88:0/829344199 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264705 (secure 0 0 0) 0x7fc068001c90 con 0x7fc05c066730 2024-09-13T18:05:53.571 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:53.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 msgr2=0x7fc05c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 0x7fc05c068bf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc068005930 tx=0x7fc068009040 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 msgr2=0x7fc070048e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc078067a80 tx=0x7fc0780743b0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 shutdown_connections 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc05c066730 0x7fc05c068bf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc0700e60e0 0x7fc070048e20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0700dcf40 0x7fc0700488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 --2- 172.21.15.88:0/829344199 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc070007110 0x7fc0700d32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 >> 172.21.15.88:0/829344199 conn(0x7fc070050e10 msgr2=0x7fc0700d9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 shutdown_connections 2024-09-13T18:05:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.568+0000 7fc07e8c2700 1 -- 172.21.15.88:0/829344199 wait complete. 2024-09-13T18:05:53.575 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:05:53.586 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-09-13T18:05:52.961536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595888,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":285,"num_write_kb":2455,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238464,"kb_used_data":1856,"kb_used_omap":12,"kb_used_meta":236531,"kb_avail":754736256,"statfs":{"total":773094113280,"available":772849926144,"internally_reserved":0,"allocated":1900544,"data_stored":1744550,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12744,"internal_metadata":242208312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1800,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004715"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480915+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:05:27.480915+0000","last_peered":"2024-09-13T18:05:27.480915+0000","last_clean":"2024-09-13T18:05:27.480915+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:05:27.480915+0000","last_undegraded":"2024-09-13T18:05:27.480915+0000","last_fullsized":"2024-09-13T18:05:27.480915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.483083+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:05:27.483083+0000","last_peered":"2024-09-13T18:05:27.483083+0000","last_clean":"2024-09-13T18:05:27.483083+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:05:27.483083+0000","last_undegraded":"2024-09-13T18:05:27.483083+0000","last_fullsized":"2024-09-13T18:05:27.483083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753359+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:05:27.753359+0000","last_peered":"2024-09-13T18:05:27.753359+0000","last_clean":"2024-09-13T18:05:27.753359+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:05:27.753359+0000","last_undegraded":"2024-09-13T18:05:27.753359+0000","last_fullsized":"2024-09-13T18:05:27.753359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747712+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:05:27.747712+0000","last_peered":"2024-09-13T18:05:27.747712+0000","last_clean":"2024-09-13T18:05:27.747712+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:05:27.747712+0000","last_undegraded":"2024-09-13T18:05:27.747712+0000","last_fullsized":"2024-09-13T18:05:27.747712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480354+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:05:27.480354+0000","last_peered":"2024-09-13T18:05:27.480354+0000","last_clean":"2024-09-13T18:05:27.480354+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:05:27.480354+0000","last_undegraded":"2024-09-13T18:05:27.480354+0000","last_fullsized":"2024-09-13T18:05:27.480354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747496+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:05:27.747496+0000","last_peered":"2024-09-13T18:05:27.747496+0000","last_clean":"2024-09-13T18:05:27.747496+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:05:27.747496+0000","last_undegraded":"2024-09-13T18:05:27.747496+0000","last_fullsized":"2024-09-13T18:05:27.747496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480054+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:05:27.480054+0000","last_peered":"2024-09-13T18:05:27.480054+0000","last_clean":"2024-09-13T18:05:27.480054+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:05:27.480054+0000","last_undegraded":"2024-09-13T18:05:27.480054+0000","last_fullsized":"2024-09-13T18:05:27.480054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.490965+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.490742+0000","last_became_peered":"2024-09-13T18:05:26.490742+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481039+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:05:27.481039+0000","last_peered":"2024-09-13T18:05:27.481039+0000","last_clean":"2024-09-13T18:05:27.481039+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:05:27.481039+0000","last_undegraded":"2024-09-13T18:05:27.481039+0000","last_fullsized":"2024-09-13T18:05:27.481039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751132+0000","last_change":"2024-09-13T18:05:26.498413+0000","last_active":"2024-09-13T18:05:27.751132+0000","last_peered":"2024-09-13T18:05:27.751132+0000","last_clean":"2024-09-13T18:05:27.751132+0000","last_became_active":"2024-09-13T18:05:26.497405+0000","last_became_peered":"2024-09-13T18:05:26.497405+0000","last_unstale":"2024-09-13T18:05:27.751132+0000","last_undegraded":"2024-09-13T18:05:27.751132+0000","last_fullsized":"2024-09-13T18:05:27.751132+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750822+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:05:27.750822+0000","last_peered":"2024-09-13T18:05:27.750822+0000","last_clean":"2024-09-13T18:05:27.750822+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:05:27.750822+0000","last_undegraded":"2024-09-13T18:05:27.750822+0000","last_fullsized":"2024-09-13T18:05:27.750822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481744+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:05:27.481744+0000","last_peered":"2024-09-13T18:05:27.481744+0000","last_clean":"2024-09-13T18:05:27.481744+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:05:27.481744+0000","last_undegraded":"2024-09-13T18:05:27.481744+0000","last_fullsized":"2024-09-13T18:05:27.481744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755124+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:05:27.755124+0000","last_peered":"2024-09-13T18:05:27.755124+0000","last_clean":"2024-09-13T18:05:27.755124+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:05:27.755124+0000","last_undegraded":"2024-09-13T18:05:27.755124+0000","last_fullsized":"2024-09-13T18:05:27.755124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754077+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:05:27.754077+0000","last_peered":"2024-09-13T18:05:27.754077+0000","last_clean":"2024-09-13T18:05:27.754077+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:05:27.754077+0000","last_undegraded":"2024-09-13T18:05:27.754077+0000","last_fullsized":"2024-09-13T18:05:27.754077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482641+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:05:27.482641+0000","last_peered":"2024-09-13T18:05:27.482641+0000","last_clean":"2024-09-13T18:05:27.482641+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:05:27.482641+0000","last_undegraded":"2024-09-13T18:05:27.482641+0000","last_fullsized":"2024-09-13T18:05:27.482641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.746914+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:05:27.746914+0000","last_peered":"2024-09-13T18:05:27.746914+0000","last_clean":"2024-09-13T18:05:27.746914+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:05:27.746914+0000","last_undegraded":"2024-09-13T18:05:27.746914+0000","last_fullsized":"2024-09-13T18:05:27.746914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748676+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:05:27.748676+0000","last_peered":"2024-09-13T18:05:27.748676+0000","last_clean":"2024-09-13T18:05:27.748676+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:05:27.748676+0000","last_undegraded":"2024-09-13T18:05:27.748676+0000","last_fullsized":"2024-09-13T18:05:27.748676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752723+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:05:27.752723+0000","last_peered":"2024-09-13T18:05:27.752723+0000","last_clean":"2024-09-13T18:05:27.752723+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:05:27.752723+0000","last_undegraded":"2024-09-13T18:05:27.752723+0000","last_fullsized":"2024-09-13T18:05:27.752723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480594+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:05:27.480594+0000","last_peered":"2024-09-13T18:05:27.480594+0000","last_clean":"2024-09-13T18:05:27.480594+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:05:27.480594+0000","last_undegraded":"2024-09-13T18:05:27.480594+0000","last_fullsized":"2024-09-13T18:05:27.480594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750740+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:05:27.750740+0000","last_peered":"2024-09-13T18:05:27.750740+0000","last_clean":"2024-09-13T18:05:27.750740+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:05:27.750740+0000","last_undegraded":"2024-09-13T18:05:27.750740+0000","last_fullsized":"2024-09-13T18:05:27.750740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753401+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:05:27.753401+0000","last_peered":"2024-09-13T18:05:27.753401+0000","last_clean":"2024-09-13T18:05:27.753401+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:05:27.753401+0000","last_undegraded":"2024-09-13T18:05:27.753401+0000","last_fullsized":"2024-09-13T18:05:27.753401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747554+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:05:27.747554+0000","last_peered":"2024-09-13T18:05:27.747554+0000","last_clean":"2024-09-13T18:05:27.747554+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:05:27.747554+0000","last_undegraded":"2024-09-13T18:05:27.747554+0000","last_fullsized":"2024-09-13T18:05:27.747554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754820+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:05:27.754820+0000","last_peered":"2024-09-13T18:05:27.754820+0000","last_clean":"2024-09-13T18:05:27.754820+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:05:27.754820+0000","last_undegraded":"2024-09-13T18:05:27.754820+0000","last_fullsized":"2024-09-13T18:05:27.754820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747131+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:05:27.747131+0000","last_peered":"2024-09-13T18:05:27.747131+0000","last_clean":"2024-09-13T18:05:27.747131+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:05:27.747131+0000","last_undegraded":"2024-09-13T18:05:27.747131+0000","last_fullsized":"2024-09-13T18:05:27.747131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755536+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:05:27.755536+0000","last_peered":"2024-09-13T18:05:27.755536+0000","last_clean":"2024-09-13T18:05:27.755536+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:05:27.755536+0000","last_undegraded":"2024-09-13T18:05:27.755536+0000","last_fullsized":"2024-09-13T18:05:27.755536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.751250+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:05:27.751250+0000","last_peered":"2024-09-13T18:05:27.751250+0000","last_clean":"2024-09-13T18:05:27.751250+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:05:27.751250+0000","last_undegraded":"2024-09-13T18:05:27.751250+0000","last_fullsized":"2024-09-13T18:05:27.751250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482747+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:05:27.482747+0000","last_peered":"2024-09-13T18:05:27.482747+0000","last_clean":"2024-09-13T18:05:27.482747+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:05:27.482747+0000","last_undegraded":"2024-09-13T18:05:27.482747+0000","last_fullsized":"2024-09-13T18:05:27.482747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755763+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:05:27.755763+0000","last_peered":"2024-09-13T18:05:27.755763+0000","last_clean":"2024-09-13T18:05:27.755763+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:05:27.755763+0000","last_undegraded":"2024-09-13T18:05:27.755763+0000","last_fullsized":"2024-09-13T18:05:27.755763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753603+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:05:27.753603+0000","last_peered":"2024-09-13T18:05:27.753603+0000","last_clean":"2024-09-13T18:05:27.753603+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:05:27.753603+0000","last_undegraded":"2024-09-13T18:05:27.753603+0000","last_fullsized":"2024-09-13T18:05:27.753603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747753+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:05:27.747753+0000","last_peered":"2024-09-13T18:05:27.747753+0000","last_clean":"2024-09-13T18:05:27.747753+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:05:27.747753+0000","last_undegraded":"2024-09-13T18:05:27.747753+0000","last_fullsized":"2024-09-13T18:05:27.747753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752397+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:05:27.752397+0000","last_peered":"2024-09-13T18:05:27.752397+0000","last_clean":"2024-09-13T18:05:27.752397+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:05:27.752397+0000","last_undegraded":"2024-09-13T18:05:27.752397+0000","last_fullsized":"2024-09-13T18:05:27.752397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750289+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:05:27.750289+0000","last_peered":"2024-09-13T18:05:27.750289+0000","last_clean":"2024-09-13T18:05:27.750289+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:05:27.750289+0000","last_undegraded":"2024-09-13T18:05:27.750289+0000","last_fullsized":"2024-09-13T18:05:27.750289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480063+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:05:27.480063+0000","last_peered":"2024-09-13T18:05:27.480063+0000","last_clean":"2024-09-13T18:05:27.480063+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:05:27.480063+0000","last_undegraded":"2024-09-13T18:05:27.480063+0000","last_fullsized":"2024-09-13T18:05:27.480063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.525454+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:05:36.525454+0000","last_peered":"2024-09-13T18:05:36.525454+0000","last_clean":"2024-09-13T18:05:36.525454+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:05:36.525454+0000","last_undegraded":"2024-09-13T18:05:36.525454+0000","last_fullsized":"2024-09-13T18:05:36.525454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1016,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753724+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:05:27.753724+0000","last_peered":"2024-09-13T18:05:27.753724+0000","last_clean":"2024-09-13T18:05:27.753724+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:05:27.753724+0000","last_undegraded":"2024-09-13T18:05:27.753724+0000","last_fullsized":"2024-09-13T18:05:27.753724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.553505+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:05:42.553505+0000","last_peered":"2024-09-13T18:05:42.553505+0000","last_clean":"2024-09-13T18:05:42.553505+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:05:42.553505+0000","last_undegraded":"2024-09-13T18:05:42.553505+0000","last_fullsized":"2024-09-13T18:05:42.553505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.553024+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:05:42.553024+0000","last_peered":"2024-09-13T18:05:42.553024+0000","last_clean":"2024-09-13T18:05:42.553024+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:05:42.553024+0000","last_undegraded":"2024-09-13T18:05:42.553024+0000","last_fullsized":"2024-09-13T18:05:42.553024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754608+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:05:27.754608+0000","last_peered":"2024-09-13T18:05:27.754608+0000","last_clean":"2024-09-13T18:05:27.754608+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:05:27.754608+0000","last_undegraded":"2024-09-13T18:05:27.754608+0000","last_fullsized":"2024-09-13T18:05:27.754608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044702+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:05:28.044702+0000","last_peered":"2024-09-13T18:05:28.044702+0000","last_clean":"2024-09-13T18:05:28.044702+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:05:28.044702+0000","last_undegraded":"2024-09-13T18:05:28.044702+0000","last_fullsized":"2024-09-13T18:05:28.044702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482574+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:05:27.482574+0000","last_peered":"2024-09-13T18:05:27.482574+0000","last_clean":"2024-09-13T18:05:27.482574+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:05:27.482574+0000","last_undegraded":"2024-09-13T18:05:27.482574+0000","last_fullsized":"2024-09-13T18:05:27.482574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516853+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:05:36.516853+0000","last_peered":"2024-09-13T18:05:36.516853+0000","last_clean":"2024-09-13T18:05:36.516853+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:05:36.516853+0000","last_undegraded":"2024-09-13T18:05:36.516853+0000","last_fullsized":"2024-09-13T18:05:36.516853+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748291+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:05:27.748291+0000","last_peered":"2024-09-13T18:05:27.748291+0000","last_clean":"2024-09-13T18:05:27.748291+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:05:27.748291+0000","last_undegraded":"2024-09-13T18:05:27.748291+0000","last_fullsized":"2024-09-13T18:05:27.748291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516088+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:05:36.516088+0000","last_peered":"2024-09-13T18:05:36.516088+0000","last_clean":"2024-09-13T18:05:36.516088+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:05:36.516088+0000","last_undegraded":"2024-09-13T18:05:36.516088+0000","last_fullsized":"2024-09-13T18:05:36.516088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753351+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:05:27.753351+0000","last_peered":"2024-09-13T18:05:27.753351+0000","last_clean":"2024-09-13T18:05:27.753351+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:05:27.753351+0000","last_undegraded":"2024-09-13T18:05:27.753351+0000","last_fullsized":"2024-09-13T18:05:27.753351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.488549+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:05:31.488549+0000","last_peered":"2024-09-13T18:05:31.488549+0000","last_clean":"2024-09-13T18:05:31.488549+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:05:31.488549+0000","last_undegraded":"2024-09-13T18:05:31.488549+0000","last_fullsized":"2024-09-13T18:05:31.488549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481769+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:05:27.481769+0000","last_peered":"2024-09-13T18:05:27.481769+0000","last_clean":"2024-09-13T18:05:27.481769+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:05:27.481769+0000","last_undegraded":"2024-09-13T18:05:27.481769+0000","last_fullsized":"2024-09-13T18:05:27.481769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.518973+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:05:36.518973+0000","last_peered":"2024-09-13T18:05:36.518973+0000","last_clean":"2024-09-13T18:05:36.518973+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:05:36.518973+0000","last_undegraded":"2024-09-13T18:05:36.518973+0000","last_fullsized":"2024-09-13T18:05:36.518973+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480071+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:05:27.480071+0000","last_peered":"2024-09-13T18:05:27.480071+0000","last_clean":"2024-09-13T18:05:27.480071+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:05:27.480071+0000","last_undegraded":"2024-09-13T18:05:27.480071+0000","last_fullsized":"2024-09-13T18:05:27.480071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.554679+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:05:42.554679+0000","last_peered":"2024-09-13T18:05:42.554679+0000","last_clean":"2024-09-13T18:05:42.554679+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:05:42.554679+0000","last_undegraded":"2024-09-13T18:05:42.554679+0000","last_fullsized":"2024-09-13T18:05:42.554679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754167+0000","last_change":"2024-09-13T18:05:26.487928+0000","last_active":"2024-09-13T18:05:27.754167+0000","last_peered":"2024-09-13T18:05:27.754167+0000","last_clean":"2024-09-13T18:05:27.754167+0000","last_became_active":"2024-09-13T18:05:26.487678+0000","last_became_peered":"2024-09-13T18:05:26.487678+0000","last_unstale":"2024-09-13T18:05:27.754167+0000","last_undegraded":"2024-09-13T18:05:27.754167+0000","last_fullsized":"2024-09-13T18:05:27.754167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.521855+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:05:36.521855+0000","last_peered":"2024-09-13T18:05:36.521855+0000","last_clean":"2024-09-13T18:05:36.521855+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:05:36.521855+0000","last_undegraded":"2024-09-13T18:05:36.521855+0000","last_fullsized":"2024-09-13T18:05:36.521855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480456+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:05:27.480456+0000","last_peered":"2024-09-13T18:05:27.480456+0000","last_clean":"2024-09-13T18:05:27.480456+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:05:27.480456+0000","last_undegraded":"2024-09-13T18:05:27.480456+0000","last_fullsized":"2024-09-13T18:05:27.480456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.554412+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:05:42.554412+0000","last_peered":"2024-09-13T18:05:42.554412+0000","last_clean":"2024-09-13T18:05:42.554412+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:05:42.554412+0000","last_undegraded":"2024-09-13T18:05:42.554412+0000","last_fullsized":"2024-09-13T18:05:42.554412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750442+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:05:27.750442+0000","last_peered":"2024-09-13T18:05:27.750442+0000","last_clean":"2024-09-13T18:05:27.750442+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:05:27.750442+0000","last_undegraded":"2024-09-13T18:05:27.750442+0000","last_fullsized":"2024-09-13T18:05:27.750442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'15","reported_seq":26,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556321+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:05:42.556321+0000","last_peered":"2024-09-13T18:05:42.556321+0000","last_clean":"2024-09-13T18:05:42.556321+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:05:42.556321+0000","last_undegraded":"2024-09-13T18:05:42.556321+0000","last_fullsized":"2024-09-13T18:05:42.556321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480303+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:05:27.480303+0000","last_peered":"2024-09-13T18:05:27.480303+0000","last_clean":"2024-09-13T18:05:27.480303+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:05:27.480303+0000","last_undegraded":"2024-09-13T18:05:27.480303+0000","last_fullsized":"2024-09-13T18:05:27.480303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.485788+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:05:31.485788+0000","last_peered":"2024-09-13T18:05:31.485788+0000","last_clean":"2024-09-13T18:05:31.485788+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:05:31.485788+0000","last_undegraded":"2024-09-13T18:05:31.485788+0000","last_fullsized":"2024-09-13T18:05:31.485788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480777+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:05:27.480777+0000","last_peered":"2024-09-13T18:05:27.480777+0000","last_clean":"2024-09-13T18:05:27.480777+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:05:27.480777+0000","last_undegraded":"2024-09-13T18:05:27.480777+0000","last_fullsized":"2024-09-13T18:05:27.480777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.487627+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:05:31.487627+0000","last_peered":"2024-09-13T18:05:31.487627+0000","last_clean":"2024-09-13T18:05:31.487627+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:05:31.487627+0000","last_undegraded":"2024-09-13T18:05:31.487627+0000","last_fullsized":"2024-09-13T18:05:31.487627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481042+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:05:27.481042+0000","last_peered":"2024-09-13T18:05:27.481042+0000","last_clean":"2024-09-13T18:05:27.481042+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:05:27.481042+0000","last_undegraded":"2024-09-13T18:05:27.481042+0000","last_fullsized":"2024-09-13T18:05:27.481042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482911+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:05:27.482911+0000","last_peered":"2024-09-13T18:05:27.482911+0000","last_clean":"2024-09-13T18:05:27.482911+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:05:27.482911+0000","last_undegraded":"2024-09-13T18:05:27.482911+0000","last_fullsized":"2024-09-13T18:05:27.482911+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747994+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:05:27.747994+0000","last_peered":"2024-09-13T18:05:27.747994+0000","last_clean":"2024-09-13T18:05:27.747994+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:05:27.747994+0000","last_undegraded":"2024-09-13T18:05:27.747994+0000","last_fullsized":"2024-09-13T18:05:27.747994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.555354+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:05:42.555354+0000","last_peered":"2024-09-13T18:05:42.555354+0000","last_clean":"2024-09-13T18:05:42.555354+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:05:42.555354+0000","last_undegraded":"2024-09-13T18:05:42.555354+0000","last_fullsized":"2024-09-13T18:05:42.555354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.480187+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:05:27.480187+0000","last_peered":"2024-09-13T18:05:27.480187+0000","last_clean":"2024-09-13T18:05:27.480187+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:05:27.480187+0000","last_undegraded":"2024-09-13T18:05:27.480187+0000","last_fullsized":"2024-09-13T18:05:27.480187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.474286+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:05:26.474286+0000","last_peered":"2024-09-13T18:05:26.474286+0000","last_clean":"2024-09-13T18:05:26.474286+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:05:26.474286+0000","last_undegraded":"2024-09-13T18:05:26.474286+0000","last_fullsized":"2024-09-13T18:05:26.474286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519034+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:05:36.519034+0000","last_peered":"2024-09-13T18:05:36.519034+0000","last_clean":"2024-09-13T18:05:36.519034+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:05:36.519034+0000","last_undegraded":"2024-09-13T18:05:36.519034+0000","last_fullsized":"2024-09-13T18:05:36.519034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755274+0000","last_change":"2024-09-13T18:05:26.505741+0000","last_active":"2024-09-13T18:05:27.755274+0000","last_peered":"2024-09-13T18:05:27.755274+0000","last_clean":"2024-09-13T18:05:27.755274+0000","last_became_active":"2024-09-13T18:05:26.505466+0000","last_became_peered":"2024-09-13T18:05:26.505466+0000","last_unstale":"2024-09-13T18:05:27.755274+0000","last_undegraded":"2024-09-13T18:05:27.755274+0000","last_fullsized":"2024-09-13T18:05:27.755274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:13:59.883244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.551636+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:05:42.551636+0000","last_peered":"2024-09-13T18:05:42.551636+0000","last_clean":"2024-09-13T18:05:42.551636+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:05:42.551636+0000","last_undegraded":"2024-09-13T18:05:42.551636+0000","last_fullsized":"2024-09-13T18:05:42.551636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753090+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:05:27.753090+0000","last_peered":"2024-09-13T18:05:27.753090+0000","last_clean":"2024-09-13T18:05:27.753090+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:05:27.753090+0000","last_undegraded":"2024-09-13T18:05:27.753090+0000","last_fullsized":"2024-09-13T18:05:27.753090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556085+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:05:42.556085+0000","last_peered":"2024-09-13T18:05:42.556085+0000","last_clean":"2024-09-13T18:05:42.556085+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:05:42.556085+0000","last_undegraded":"2024-09-13T18:05:42.556085+0000","last_fullsized":"2024-09-13T18:05:42.556085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482394+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:05:27.482394+0000","last_peered":"2024-09-13T18:05:27.482394+0000","last_clean":"2024-09-13T18:05:27.482394+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:05:27.482394+0000","last_undegraded":"2024-09-13T18:05:27.482394+0000","last_fullsized":"2024-09-13T18:05:27.482394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:28.044806+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:05:28.044806+0000","last_peered":"2024-09-13T18:05:28.044806+0000","last_clean":"2024-09-13T18:05:28.044806+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:05:28.044806+0000","last_undegraded":"2024-09-13T18:05:28.044806+0000","last_fullsized":"2024-09-13T18:05:28.044806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.481547+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:05:27.481547+0000","last_peered":"2024-09-13T18:05:27.481547+0000","last_clean":"2024-09-13T18:05:27.481547+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:05:27.481547+0000","last_undegraded":"2024-09-13T18:05:27.481547+0000","last_fullsized":"2024-09-13T18:05:27.481547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-13T18:05:26.481047+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:05:26.481047+0000","last_peered":"2024-09-13T18:05:26.481047+0000","last_clean":"2024-09-13T18:05:26.481047+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:05:26.481047+0000","last_undegraded":"2024-09-13T18:05:26.481047+0000","last_fullsized":"2024-09-13T18:05:26.481047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748342+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:05:27.748342+0000","last_peered":"2024-09-13T18:05:27.748342+0000","last_clean":"2024-09-13T18:05:27.748342+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:05:27.748342+0000","last_undegraded":"2024-09-13T18:05:27.748342+0000","last_fullsized":"2024-09-13T18:05:27.748342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:30.033041+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:05:30.033041+0000","last_peered":"2024-09-13T18:05:30.033041+0000","last_clean":"2024-09-13T18:05:30.033041+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:05:30.033041+0000","last_undegraded":"2024-09-13T18:05:30.033041+0000","last_fullsized":"2024-09-13T18:05:30.033041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482961+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:05:27.482961+0000","last_peered":"2024-09-13T18:05:27.482961+0000","last_clean":"2024-09-13T18:05:27.482961+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:05:27.482961+0000","last_undegraded":"2024-09-13T18:05:27.482961+0000","last_fullsized":"2024-09-13T18:05:27.482961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.555096+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:05:42.555096+0000","last_peered":"2024-09-13T18:05:42.555096+0000","last_clean":"2024-09-13T18:05:42.555096+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:05:42.555096+0000","last_undegraded":"2024-09-13T18:05:42.555096+0000","last_fullsized":"2024-09-13T18:05:42.555096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755753+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:05:27.755753+0000","last_peered":"2024-09-13T18:05:27.755753+0000","last_clean":"2024-09-13T18:05:27.755753+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:05:27.755753+0000","last_undegraded":"2024-09-13T18:05:27.755753+0000","last_fullsized":"2024-09-13T18:05:27.755753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.516383+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:05:36.516383+0000","last_peered":"2024-09-13T18:05:36.516383+0000","last_clean":"2024-09-13T18:05:36.516383+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:05:36.516383+0000","last_undegraded":"2024-09-13T18:05:36.516383+0000","last_fullsized":"2024-09-13T18:05:36.516383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.752933+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:05:27.752933+0000","last_peered":"2024-09-13T18:05:27.752933+0000","last_clean":"2024-09-13T18:05:27.752933+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:05:27.752933+0000","last_undegraded":"2024-09-13T18:05:27.752933+0000","last_fullsized":"2024-09-13T18:05:27.752933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519555+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:05:36.519555+0000","last_peered":"2024-09-13T18:05:36.519555+0000","last_clean":"2024-09-13T18:05:36.519555+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:05:36.519555+0000","last_undegraded":"2024-09-13T18:05:36.519555+0000","last_fullsized":"2024-09-13T18:05:36.519555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.479793+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:05:27.479793+0000","last_peered":"2024-09-13T18:05:27.479793+0000","last_clean":"2024-09-13T18:05:27.479793+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:05:27.479793+0000","last_undegraded":"2024-09-13T18:05:27.479793+0000","last_fullsized":"2024-09-13T18:05:27.479793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.519873+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:05:36.519873+0000","last_peered":"2024-09-13T18:05:36.519873+0000","last_clean":"2024-09-13T18:05:36.519873+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:05:36.519873+0000","last_undegraded":"2024-09-13T18:05:36.519873+0000","last_fullsized":"2024-09-13T18:05:36.519873+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.754707+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:05:27.754707+0000","last_peered":"2024-09-13T18:05:27.754707+0000","last_clean":"2024-09-13T18:05:27.754707+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:05:27.754707+0000","last_undegraded":"2024-09-13T18:05:27.754707+0000","last_fullsized":"2024-09-13T18:05:27.754707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.482759+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:05:27.482759+0000","last_peered":"2024-09-13T18:05:27.482759+0000","last_clean":"2024-09-13T18:05:27.482759+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:05:27.482759+0000","last_undegraded":"2024-09-13T18:05:27.482759+0000","last_fullsized":"2024-09-13T18:05:27.482759+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755078+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:05:27.755078+0000","last_peered":"2024-09-13T18:05:27.755078+0000","last_clean":"2024-09-13T18:05:27.755078+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:05:27.755078+0000","last_undegraded":"2024-09-13T18:05:27.755078+0000","last_fullsized":"2024-09-13T18:05:27.755078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:36.517844+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:05:36.517844+0000","last_peered":"2024-09-13T18:05:36.517844+0000","last_clean":"2024-09-13T18:05:36.517844+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:05:36.517844+0000","last_undegraded":"2024-09-13T18:05:36.517844+0000","last_fullsized":"2024-09-13T18:05:36.517844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.750568+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:05:27.750568+0000","last_peered":"2024-09-13T18:05:27.750568+0000","last_clean":"2024-09-13T18:05:27.750568+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:05:27.750568+0000","last_undegraded":"2024-09-13T18:05:27.750568+0000","last_fullsized":"2024-09-13T18:05:27.750568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.748170+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:05:27.748170+0000","last_peered":"2024-09-13T18:05:27.748170+0000","last_clean":"2024-09-13T18:05:27.748170+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:05:27.748170+0000","last_undegraded":"2024-09-13T18:05:27.748170+0000","last_fullsized":"2024-09-13T18:05:27.748170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.483826+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:05:31.483826+0000","last_peered":"2024-09-13T18:05:31.483826+0000","last_clean":"2024-09-13T18:05:31.483826+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:05:31.483826+0000","last_undegraded":"2024-09-13T18:05:31.483826+0000","last_fullsized":"2024-09-13T18:05:31.483826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.747798+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:05:27.747798+0000","last_peered":"2024-09-13T18:05:27.747798+0000","last_clean":"2024-09-13T18:05:27.747798+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:05:27.747798+0000","last_undegraded":"2024-09-13T18:05:27.747798+0000","last_fullsized":"2024-09-13T18:05:27.747798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.552928+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:05:42.552928+0000","last_peered":"2024-09-13T18:05:42.552928+0000","last_clean":"2024-09-13T18:05:42.552928+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:05:42.552928+0000","last_undegraded":"2024-09-13T18:05:42.552928+0000","last_fullsized":"2024-09-13T18:05:42.552928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.753147+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:05:27.753147+0000","last_peered":"2024-09-13T18:05:27.753147+0000","last_clean":"2024-09-13T18:05:27.753147+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:05:27.753147+0000","last_undegraded":"2024-09-13T18:05:27.753147+0000","last_fullsized":"2024-09-13T18:05:27.753147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:31.489018+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:05:31.489018+0000","last_peered":"2024-09-13T18:05:31.489018+0000","last_clean":"2024-09-13T18:05:31.489018+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:05:31.489018+0000","last_undegraded":"2024-09-13T18:05:31.489018+0000","last_fullsized":"2024-09-13T18:05:31.489018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:27.755299+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:05:27.755299+0000","last_peered":"2024-09-13T18:05:27.755299+0000","last_clean":"2024-09-13T18:05:27.755299+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:05:27.755299+0000","last_undegraded":"2024-09-13T18:05:27.755299+0000","last_fullsized":"2024-09-13T18:05:27.755299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:05:42.556891+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:05:42.556891+0000","last_peered":"2024-09-13T18:05:42.556891+0000","last_clean":"2024-09-13T18:05:42.556891+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:05:42.556891+0000","last_undegraded":"2024-09-13T18:05:42.556891+0000","last_fullsized":"2024-09-13T18:05:42.556891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5520,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":11040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":221184,"data_stored":69970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":70096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.105}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":661230,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":221184,"data_stored":71346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":217088,"data_stored":69818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":225280,"data_stored":71380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":221184,"data_stored":70530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":282624,"data_stored":660180,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:05:53.591 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-13T18:05:53.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:05:53.700 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 Processor -- start 2024-09-13T18:05:53.701 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 -- start start 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1fc406f6a0 0x7f1fc406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc406dce0 con 0x7f1fc40c3e30 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc406bcb0 con 0x7f1fc4150b30 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc8e08700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc406e010 con 0x7f1fc406f6a0 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc3fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1fc40c3e30 0x7f1fc41615a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46952/0 (socket says 172.21.15.88:46952) 2024-09-13T18:05:53.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc3fff700 1 -- 172.21.15.88:0/175785134 learned_addr learned my addr 172.21.15.88:0/175785134 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> v2:172.21.15.94:3300/0 conn(0x7f1fc406f6a0 0x7f1fc406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329666314 0 0) 0x7f1fc406dce0 con 0x7f1fc40c3e30 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.696+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa80035d0 con 0x7f1fc40c3e30 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 925481452 0 0) 0x7f1fa80035d0 con 0x7f1fc40c3e30 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 >> v2:172.21.15.94:3300/0 conn(0x7f1fc406f6a0 msgr2=0x7f1fc406fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 --2- 172.21.15.88:0/175785134 >> v2:172.21.15.94:3300/0 conn(0x7f1fc406f6a0 0x7f1fc406fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 >> v1:172.21.15.94:6789/0 conn(0x7f1fc4150b30 legacy=0x7f1fc406e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc406bf70 con 0x7f1fc40c3e30 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f1fbc001670 con 0x7f1fc40c3e30 2024-09-13T18:05:53.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> v2:172.21.15.94:3300/0 conn(0x7f1fc406f6a0 0x7f1fc406fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 >> v1:172.21.15.88:6789/0 conn(0x7f1fc40c3e30 legacy=0x7f1fc41615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fa8003a20 0x7f1fa8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fa80048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fa80050f0 0x7f1fa800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc406e010 con 0x7f1fa8004420 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa800bfa0 con 0x7f1fa80050f0 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa800c160 con 0x7f1fa8003a20 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fa80048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc3fff700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fa80050f0 0x7f1fa800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc37fe700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fa8003a20 0x7f1fa8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 -- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fa8003a20 msgr2=0x7f1fa8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fa8003a20 0x7f1fa8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 -- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fa80050f0 msgr2=0x7f1fa800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fa80050f0 0x7f1fa800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 -- 172.21.15.88:0/175785134 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80035d0 con 0x7f1fa8004420 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc3fff700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fa80050f0 0x7f1fa800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc3fff700 1 -- 172.21.15.88:0/175785134 reap_dead start 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fa80048f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400e350 tx=0x7f1fa80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8dbbf088262d06 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb400edf0 con 0x7f1fa8004420 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb400f040 con 0x7f1fa8004420 2024-09-13T18:05:53.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc27fc700 1 -- 172.21.15.88:0/175785134 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40146a0 con 0x7f1fa8004420 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 -- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 msgr2=0x7f1fa80048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fa80048f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400e350 tx=0x7f1fa80058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 -- 172.21.15.88:0/175785134 shutdown_connections 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/175785134 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fa80048f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 -- 172.21.15.88:0/175785134 >> 172.21.15.88:0/175785134 conn(0x7f1fc40ca720 msgr2=0x7f1fc40cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 -- 172.21.15.88:0/175785134 shutdown_connections 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.700+0000 7f1fc8e08700 1 -- 172.21.15.88:0/175785134 wait complete. 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.704+0000 7f1fc8e08700 1 Processor -- start 2024-09-13T18:05:53.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.704+0000 7f1fc8e08700 1 -- start start 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.704+0000 7f1fc8e08700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fc4148110 0x7f1fc4154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fc4148530 0x7f1fc41550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4155fe0 con 0x7f1fa8004420 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43946/0 (socket says 172.21.15.88:43946) 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 -- 172.21.15.88:0/648446536 learned_addr learned my addr 172.21.15.88:0/648446536 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc3fff700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fc4148530 0x7f1fc41550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc4152690 con 0x7f1fc4148530 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc41ea780 con 0x7f1fc4148110 2024-09-13T18:05:53.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fc4148110 0x7f1fc4154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 -- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fc4148110 msgr2=0x7f1fc4154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fc4148110 0x7f1fc4154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 -- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fc4148530 msgr2=0x7f1fc41550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fc4148530 0x7f1fc41550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4156280 con 0x7f1fa8004420 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc37fe700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e800 tx=0x7f1fb000eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00052e0 con 0x7f1fa8004420 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0005440 con 0x7f1fa8004420 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc4156560 con 0x7f1fa8004420 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00038e0 con 0x7f1fa8004420 2024-09-13T18:05:53.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc414e350 con 0x7f1fa8004420 2024-09-13T18:05:53.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.708+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc4156a80 con 0x7f1fa8004420 2024-09-13T18:05:53.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.712+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1fb0003a40 con 0x7f1fa8004420 2024-09-13T18:05:53.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.712+0000 7f1fbbfff700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 0x7f1fac068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:53.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.712+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fb0084770 con 0x7f1fa8004420 2024-09-13T18:05:53.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.712+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 0x7f1fac068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:53.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.716+0000 7f1fc2ffd700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 0x7f1fac068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4017040 tx=0x7f1fb4013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:53.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.720+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1fb0051ac0 con 0x7f1fa8004420 2024-09-13T18:05:53.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.892+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fc4156a80 con 0x7f1fa8004420 2024-09-13T18:05:53.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fbbfff700 1 -- 172.21.15.88:0/648446536 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16457 (secure 0 0 0) 0x7f1fc4156a80 con 0x7f1fa8004420 2024-09-13T18:05:53.899 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:53.899 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":20,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:05:27.469135+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:05:53.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 msgr2=0x7f1fac068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 0x7f1fac068c20 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4017040 tx=0x7f1fb4013000 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 msgr2=0x7f1fc4152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000e800 tx=0x7f1fb000eb10 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 shutdown_connections 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1fac066760 0x7f1fac068c20 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fc4148110 0x7f1fc4154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fc4148530 0x7f1fc41550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 --2- 172.21.15.88:0/648446536 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1fa8004420 0x7f1fc4152150 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 >> 172.21.15.88:0/648446536 conn(0x7f1fc40ca720 msgr2=0x7f1fc40c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 shutdown_connections 2024-09-13T18:05:53.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:53.896+0000 7f1fc8e08700 1 -- 172.21.15.88:0/648446536 wait complete. 2024-09-13T18:05:53.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:05:53.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:05:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.024+0000 7ffa5d70d700 1 Processor -- start 2024-09-13T18:05:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.024+0000 7ffa5d70d700 1 -- start start 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa5814fd20 0x7ffa580c8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa58159c00 0x7ffa580c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa58159060 con 0x7ffa580c8c80 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580cb650 con 0x7ffa58159c00 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa580c33f0 con 0x7ffa5814fd20 2024-09-13T18:05:54.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa58159c00 0x7ffa580c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ffa58159c00 0x7ffa580c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43960/0 (socket says 172.21.15.88:43960) 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/3220053175 learned_addr learned my addr 172.21.15.88:0/3220053175 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa57fff700 1 --2- 172.21.15.88:0/3220053175 >> v2:172.21.15.94:3300/0 conn(0x7ffa5814fd20 0x7ffa580c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/3220053175 >> v2:172.21.15.94:3300/0 conn(0x7ffa5814fd20 msgr2=0x7ffa580c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 --2- 172.21.15.88:0/3220053175 >> v2:172.21.15.94:3300/0 conn(0x7ffa5814fd20 0x7ffa580c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/3220053175 >> v1:172.21.15.94:6789/0 conn(0x7ffa580c8c80 legacy=0x7ffa581594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/3220053175 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58155a90 con 0x7ffa58159c00 2024-09-13T18:05:54.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5cf0c700 1 --2- 172.21.15.88:0/3220053175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa580c98a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa580c5e60 tx=0x7ffa5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca72d79049845fc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa577fe700 1 -- 172.21.15.88:0/3220053175 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000e070 con 0x7ffa58159c00 2024-09-13T18:05:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa577fe700 1 -- 172.21.15.88:0/3220053175 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000b910 con 0x7ffa58159c00 2024-09-13T18:05:54.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa577fe700 1 -- 172.21.15.88:0/3220053175 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000bcc0 con 0x7ffa58159c00 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- 172.21.15.88:0/3220053175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 msgr2=0x7ffa580c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/3220053175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa580c98a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffa580c5e60 tx=0x7ffa5000b330 comp rx=0 tx=0).stop 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- 172.21.15.88:0/3220053175 shutdown_connections 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/3220053175 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa580c98a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/3220053175 >> v2:172.21.15.94:3300/0 conn(0x7ffa5814fd20 0x7ffa580c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- 172.21.15.88:0/3220053175 >> 172.21.15.88:0/3220053175 conn(0x7ffa5806a820 msgr2=0x7ffa5806ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- 172.21.15.88:0/3220053175 shutdown_connections 2024-09-13T18:05:54.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.028+0000 7ffa5d70d700 1 -- 172.21.15.88:0/3220053175 wait complete. 2024-09-13T18:05:54.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 Processor -- start 2024-09-13T18:05:54.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 -- start start 2024-09-13T18:05:54.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 0x7ffa58148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 0x7ffa58154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa581ec450 con 0x7ffa58159c00 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa581ec640 con 0x7ffa580c8c80 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa581ec8e0 con 0x7ffa5814fd20 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43970/0 (socket says 172.21.15.88:43970) 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/1104233404 learned_addr learned my addr 172.21.15.88:0/1104233404 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa57fff700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 0x7ffa58148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa4f7fe700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 0x7ffa58154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 msgr2=0x7ffa58154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 0x7ffa58154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 msgr2=0x7ffa58148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 0x7ffa58148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 -- 172.21.15.88:0/1104233404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa50009b30 con 0x7ffa58159c00 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa4f7fe700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 0x7ffa58154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa57fff700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 0x7ffa58148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5cf0c700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000b370 tx=0x7ffa50004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500092e0 con 0x7ffa58159c00 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5001b430 con 0x7ffa58159c00 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa581ecbc0 con 0x7ffa58159c00 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.032+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5001b7e0 con 0x7ffa58159c00 2024-09-13T18:05:54.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa581ed180 con 0x7ffa58159c00 2024-09-13T18:05:54.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa581ed340 con 0x7ffa58159c00 2024-09-13T18:05:54.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa5001b940 con 0x7ffa58159c00 2024-09-13T18:05:54.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa557fa700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa50085700 con 0x7ffa58159c00 2024-09-13T18:05:54.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.036+0000 7ffa57fff700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.040+0000 7ffa57fff700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 0x7ffa38068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009c40 tx=0x7ffa48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.044+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ffa50052a70 con 0x7ffa58159c00 2024-09-13T18:05:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.212+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa5814f190 con 0x7ffa58159c00 2024-09-13T18:05:54.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.212+0000 7ffa557fa700 1 -- 172.21.15.88:0/1104233404 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa5814f190 con 0x7ffa58159c00 2024-09-13T18:05:54.217 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 msgr2=0x7ffa38068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 0x7ffa38068bf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009c40 tx=0x7ffa48008040 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 msgr2=0x7ffa581549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffa5000b370 tx=0x7ffa50004af0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 shutdown_connections 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa38066730 0x7ffa38068bf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa5814fd20 0x7ffa58154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa58159c00 0x7ffa581549b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 --2- 172.21.15.88:0/1104233404 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa580c8c80 0x7ffa58148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 >> 172.21.15.88:0/1104233404 conn(0x7ffa5806a820 msgr2=0x7ffa580c9fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 shutdown_connections 2024-09-13T18:05:54.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.216+0000 7ffa5d70d700 1 -- 172.21.15.88:0/1104233404 wait complete. 2024-09-13T18:05:54.232 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:05:54.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 Processor -- start 2024-09-13T18:05:54.347 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 -- start start 2024-09-13T18:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4204151430 0x7f420406feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 0x7f420406e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4204070c90 con 0x7f42040c4940 2024-09-13T18:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406d930 con 0x7f4204151430 2024-09-13T18:05:54.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420bcfe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420406e840 con 0x7f420406dea0 2024-09-13T18:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 0x7f420406e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4209a9a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4204151430 0x7f420406feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4209299700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f42040c4940 0x7f420406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45272/0 (socket says 172.21.15.88:45272) 2024-09-13T18:05:54.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4209299700 1 -- 172.21.15.88:0/3014098632 learned_addr learned my addr 172.21.15.88:0/3014098632 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4208a98700 1 -- 172.21.15.88:0/3014098632 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165185650 0 0) 0x7f4204070c90 con 0x7f42040c4940 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4208a98700 1 -- 172.21.15.88:0/3014098632 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ec0035d0 con 0x7f42040c4940 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 -- 172.21.15.88:0/3014098632 >> v2:172.21.15.94:3300/0 conn(0x7f4204151430 msgr2=0x7f420406feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 --2- 172.21.15.88:0/3014098632 >> v2:172.21.15.94:3300/0 conn(0x7f4204151430 0x7f420406feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 -- 172.21.15.88:0/3014098632 >> v1:172.21.15.94:6789/0 conn(0x7f42040c4940 legacy=0x7f420406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 -- 172.21.15.88:0/3014098632 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420415afc0 con 0x7f420406dea0 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f420a29b700 1 --2- 172.21.15.88:0/3014098632 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 0x7f420406e300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009850 tx=0x7f41f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe13dacc9ab7fd04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4208a98700 1 -- 172.21.15.88:0/3014098632 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4011830 con 0x7f420406dea0 2024-09-13T18:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4208a98700 1 -- 172.21.15.88:0/3014098632 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f4011990 con 0x7f420406dea0 2024-09-13T18:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.344+0000 7f4208a98700 1 -- 172.21.15.88:0/3014098632 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4011d00 con 0x7f420406dea0 2024-09-13T18:05:54.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- 172.21.15.88:0/3014098632 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 msgr2=0x7f420406e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- 172.21.15.88:0/3014098632 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 0x7f420406e300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f41f4009850 tx=0x7f41f4009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- 172.21.15.88:0/3014098632 shutdown_connections 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- 172.21.15.88:0/3014098632 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f420406dea0 0x7f420406e300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- 172.21.15.88:0/3014098632 >> v2:172.21.15.94:3300/0 conn(0x7f4204151430 0x7f420406feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- 172.21.15.88:0/3014098632 >> 172.21.15.88:0/3014098632 conn(0x7f42040c7320 msgr2=0x7f42040c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- 172.21.15.88:0/3014098632 shutdown_connections 2024-09-13T18:05:54.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- 172.21.15.88:0/3014098632 wait complete. 2024-09-13T18:05:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 Processor -- start 2024-09-13T18:05:54.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- start start 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420406dea0 0x7f4204153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42040c4940 0x7f42041532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4204158840 con 0x7f4204151430 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041592f0 con 0x7f420406dea0 2024-09-13T18:05:54.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420bcfe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4204154310 con 0x7f42040c4940 2024-09-13T18:05:54.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420a29b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f4209a9a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420406dea0 0x7f4204153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420a29b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43972/0 (socket says 172.21.15.88:43972) 2024-09-13T18:05:54.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.348+0000 7f420a29b700 1 -- 172.21.15.88:0/2569035914 learned_addr learned my addr 172.21.15.88:0/2569035914 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:54.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f4209299700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42040c4940 0x7f42041532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 -- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42040c4940 msgr2=0x7f42041532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42040c4940 0x7f42041532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 -- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420406dea0 msgr2=0x7f4204153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420406dea0 0x7f4204153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 -- 172.21.15.88:0/2569035914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f40094b0 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420a29b700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f420415af30 tx=0x7f41f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f4004380 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f401f070 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42041545f0 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f40036c0 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4204158f80 con 0x7f4204151430 2024-09-13T18:05:54.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4204158b00 con 0x7f4204151430 2024-09-13T18:05:54.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.352+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f41f4021030 con 0x7f4204151430 2024-09-13T18:05:54.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.356+0000 7f41fa7fc700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.356+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41f40852d0 con 0x7f4204151430 2024-09-13T18:05:54.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.356+0000 7f4209a9a700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.356+0000 7f4209a9a700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 0x7f41f0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009b50 tx=0x7f41fc009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.360+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4204158b00 con 0x7f4204151430 2024-09-13T18:05:54.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.532+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4204158b00 con 0x7f4204151430 2024-09-13T18:05:54.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f41fa7fc700 1 -- 172.21.15.88:0/2569035914 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4204158b00 con 0x7f4204151430 2024-09-13T18:05:54.539 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 msgr2=0x7f41f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 0x7f41f0068bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41fc009b50 tx=0x7f41fc009240 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 msgr2=0x7f42041e2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f420415af30 tx=0x7f41f4004770 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 shutdown_connections 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f41f0066730 0x7f41f0068bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42040c4940 0x7f42041532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4204151430 0x7f42041e2770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 --2- 172.21.15.88:0/2569035914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f420406dea0 0x7f4204153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 >> 172.21.15.88:0/2569035914 conn(0x7f42040c7320 msgr2=0x7f420406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 shutdown_connections 2024-09-13T18:05:54.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.536+0000 7f420bcfe700 1 -- 172.21.15.88:0/2569035914 wait complete. 2024-09-13T18:05:54.554 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:05:54.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 Processor -- start 2024-09-13T18:05:54.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 -- start start 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe2f0150f30 0x7fe2f00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2f00c8a90 0x7fe2f00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f015a210 con 0x7fe2f00c3770 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00c7de0 con 0x7fe2f00c8a90 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2effff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f00c8f10 con 0x7fe2f0150f30 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2ee7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2f00c8a90 0x7fe2f00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.674 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2ee7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe2f00c8a90 0x7fe2f00c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43984/0 (socket says 172.21.15.88:43984) 2024-09-13T18:05:54.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2ee7fc700 1 -- 172.21.15.88:0/1750739359 learned_addr learned my addr 172.21.15.88:0/1750739359 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:54.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.668+0000 7fe2eeffd700 1 --2- 172.21.15.88:0/1750739359 >> v2:172.21.15.94:3300/0 conn(0x7fe2f0150f30 0x7fe2f00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 -- 172.21.15.88:0/1750739359 >> v2:172.21.15.94:3300/0 conn(0x7fe2f0150f30 msgr2=0x7fe2f00c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:54.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 --2- 172.21.15.88:0/1750739359 >> v2:172.21.15.94:3300/0 conn(0x7fe2f0150f30 0x7fe2f00c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 -- 172.21.15.88:0/1750739359 >> v1:172.21.15.94:6789/0 conn(0x7fe2f00c3770 legacy=0x7fe2f00c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 -- 172.21.15.88:0/1750739359 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00c7ff0 con 0x7fe2f00c8a90 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 --2- 172.21.15.88:0/1750739359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c8a90 0x7fe2f00c4120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0067050 tx=0x7fe2e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120cde614d8480da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2edffb700 1 -- 172.21.15.88:0/1750739359 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000b8a0 con 0x7fe2f00c8a90 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2edffb700 1 -- 172.21.15.88:0/1750739359 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e000ba00 con 0x7fe2f00c8a90 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2edffb700 1 -- 172.21.15.88:0/1750739359 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e000bd90 con 0x7fe2f00c8a90 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- 172.21.15.88:0/1750739359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c8a90 msgr2=0x7fe2f00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- 172.21.15.88:0/1750739359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c8a90 0x7fe2f00c4120 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0067050 tx=0x7fe2e0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- 172.21.15.88:0/1750739359 shutdown_connections 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- 172.21.15.88:0/1750739359 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c8a90 0x7fe2f00c4120 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- 172.21.15.88:0/1750739359 >> v2:172.21.15.94:3300/0 conn(0x7fe2f0150f30 0x7fe2f00c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- 172.21.15.88:0/1750739359 >> 172.21.15.88:0/1750739359 conn(0x7fe2f0066090 msgr2=0x7fe2f00664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- 172.21.15.88:0/1750739359 shutdown_connections 2024-09-13T18:05:54.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- 172.21.15.88:0/1750739359 wait complete. 2024-09-13T18:05:54.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 Processor -- start 2024-09-13T18:05:54.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- start start 2024-09-13T18:05:54.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 0x7fe2f0151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2f0150f30 0x7fe2f01f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0142b50 con 0x7fe2f00c3770 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0070900 con 0x7fe2f00c8a90 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2effff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f0071bc0 con 0x7fe2f0150f30 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ee7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 0x7fe2f0151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2eeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43986/0 (socket says 172.21.15.88:43986) 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2eeffd700 1 -- 172.21.15.88:0/1412287234 learned_addr learned my addr 172.21.15.88:0/1412287234 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.672+0000 7fe2ef7fe700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2f0150f30 0x7fe2f01f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 -- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2f0150f30 msgr2=0x7fe2f01f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2f0150f30 0x7fe2f01f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 -- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 msgr2=0x7fe2f0151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 0x7fe2f0151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 -- 172.21.15.88:0/1412287234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e0009570 con 0x7fe2f00c3770 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2ee7fc700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 0x7fe2f0151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2eeffd700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d800 tx=0x7fe2e400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e40125f0 con 0x7fe2f00c3770 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e4012750 con 0x7fe2f00c3770 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f0071ea0 con 0x7fe2f00c3770 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4012ac0 con 0x7fe2f00c3770 2024-09-13T18:05:54.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f0070e80 con 0x7fe2f00c3770 2024-09-13T18:05:54.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.676+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f00c72b0 con 0x7fe2f00c3770 2024-09-13T18:05:54.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.680+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe2e4012c20 con 0x7fe2f00c3770 2024-09-13T18:05:54.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.680+0000 7fe2d77fe700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 0x7fe2dc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:54.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.680+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2e4084290 con 0x7fe2f00c3770 2024-09-13T18:05:54.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.680+0000 7fe2ee7fc700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 0x7fe2dc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:54.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.680+0000 7fe2ee7fc700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 0x7fe2dc068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0000c00 tx=0x7fe2e0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:54.690 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.684+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe2e4051560 con 0x7fe2f00c3770 2024-09-13T18:05:54.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.860+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe2f006ba20 con 0x7fe2f00c3770 2024-09-13T18:05:54.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.860+0000 7fe2d77fe700 1 -- 172.21.15.88:0/1412287234 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe2e4054b80 con 0x7fe2f00c3770 2024-09-13T18:05:54.864 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 msgr2=0x7fe2dc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 0x7fe2dc068bf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0000c00 tx=0x7fe2e0008030 comp rx=0 tx=0).stop 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 msgr2=0x7fe2f01e3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d800 tx=0x7fe2e400db10 comp rx=0 tx=0).stop 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 shutdown_connections 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe2dc066730 0x7fe2dc068bf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2f0150f30 0x7fe2f01f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.868 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2f00c8a90 0x7fe2f0151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 --2- 172.21.15.88:0/1412287234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2f00c3770 0x7fe2f01e3730 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 >> 172.21.15.88:0/1412287234 conn(0x7fe2f0066090 msgr2=0x7fe2f014f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 shutdown_connections 2024-09-13T18:05:54.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:54.864+0000 7fe2effff700 1 -- 172.21.15.88:0/1412287234 wait complete. 2024-09-13T18:05:54.883 DEBUG:tasks.mon_thrash:Yielding 2024-09-13T18:05:54.883 INFO:teuthology.run_tasks:Running task workunit... 2024-09-13T18:05:54.896 INFO:tasks.workunit:Pulling workunits from ref 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:05:54.897 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T18:05:54.897 INFO:tasks.workunit:timeout=3h 2024-09-13T18:05:54.897 INFO:tasks.workunit:cleanup=True 2024-09-13T18:05:54.897 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:54.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 34h/52d Inode: 1 Links: 2 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T18:05:54.907 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-09-13 18:05:31.470270352 +0000 2024-09-13T18:05:54.908 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-09-13 18:05:51.550998899 +0000 2024-09-13T18:05:54.908 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2024-09-13T18:05:54.908 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T18:05:54.908 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T18:05:54.939 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:05:54.990 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T18:05:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 Processor -- start 2024-09-13T18:05:55.016 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 -- start start 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f3c0ca570 0x7f5f3c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0c3c20 0x7f5f3c153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c06f590 con 0x7f5f3c0ca950 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c5ab0 con 0x7f5f3c0ca570 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f43567700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c159ac0 con 0x7f5f3c0c3c20 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5f3c0ca570 0x7f5f3c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42d66700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0c3c20 0x7f5f3c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.017 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f41d64700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5f3c0ca950 0x7f5f3c06fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45288/0 (socket says 172.21.15.88:45288) 2024-09-13T18:05:55.018 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f41d64700 1 -- 172.21.15.88:0/3965190298 learned_addr learned my addr 172.21.15.88:0/3965190298 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 -- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0c3c20 msgr2=0x7f5f3c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 --2- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0c3c20 0x7f5f3c153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 -- 172.21.15.88:0/3965190298 >> v1:172.21.15.94:6789/0 conn(0x7f5f3c0ca950 legacy=0x7f5f3c06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 -- 172.21.15.88:0/3965190298 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c159fb0 con 0x7f5f3c0ca570 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f42565700 1 --2- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0ca570 0x7f5f3c152f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009850 tx=0x7f5f38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8e3f84d7a2cbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f41563700 1 -- 172.21.15.88:0/3965190298 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38011830 con 0x7f5f3c0ca570 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f41563700 1 -- 172.21.15.88:0/3965190298 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f38011990 con 0x7f5f3c0ca570 2024-09-13T18:05:55.019 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.012+0000 7f5f41563700 1 -- 172.21.15.88:0/3965190298 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f38011d40 con 0x7f5f3c0ca570 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0ca570 msgr2=0x7f5f3c152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0ca570 0x7f5f3c152f10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009850 tx=0x7f5f38009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- 172.21.15.88:0/3965190298 shutdown_connections 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0c3c20 0x7f5f3c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- 172.21.15.88:0/3965190298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0ca570 0x7f5f3c152f10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- 172.21.15.88:0/3965190298 >> 172.21.15.88:0/3965190298 conn(0x7f5f3c0cb3f0 msgr2=0x7f5f3c0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- 172.21.15.88:0/3965190298 shutdown_connections 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- 172.21.15.88:0/3965190298 wait complete. 2024-09-13T18:05:55.020 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 Processor -- start 2024-09-13T18:05:55.021 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- start start 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0c3c20 0x7f5f3c1e16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0ca570 0x7f5f3c14d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1e1f70 con 0x7f5f3c0ca950 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1e3680 con 0x7f5f3c0c3c20 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f43567700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c1e3960 con 0x7f5f3c0ca570 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.023 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43992/0 (socket says 172.21.15.88:43992) 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 -- 172.21.15.88:0/2900885310 learned_addr learned my addr 172.21.15.88:0/2900885310 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42565700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0c3c20 0x7f5f3c1e16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f41d64700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0ca570 0x7f5f3c14d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 -- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0ca570 msgr2=0x7f5f3c14d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0ca570 0x7f5f3c14d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.016+0000 7f5f42d66700 1 -- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0c3c20 msgr2=0x7f5f3c1e16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f42d66700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0c3c20 0x7f5f3c1e16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f42d66700 1 -- 172.21.15.88:0/2900885310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380094b0 con 0x7f5f3c0ca950 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f42d66700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400efc0 tx=0x7f5f3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34009ea0 con 0x7f5f3c0ca950 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400f040 con 0x7f5f3c0ca950 2024-09-13T18:05:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c1e3c40 con 0x7f5f3c0ca950 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3400ced0 con 0x7f5f3c0ca950 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c1f2000 con 0x7f5f3c0ca950 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5f34014480 con 0x7f5f3c0ca950 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0678f0 con 0x7f5f3c0ca950 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 0x7f5f20068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.025 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f34084c30 con 0x7f5f3c0ca950 2024-09-13T18:05:55.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.020+0000 7f5f42565700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 0x7f5f20068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.024+0000 7f5f42565700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 0x7f5f20068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f380090b0 tx=0x7f5f38008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.028+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5f34051fa0 con 0x7f5f3c0ca950 2024-09-13T18:05:55.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.240+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f3c14e940 con 0x7f5f3c0ca950 2024-09-13T18:05:55.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.240+0000 7f5f32ffd700 1 -- 172.21.15.88:0/2900885310 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7f5f3c14e940 con 0x7f5f3c0ca950 2024-09-13T18:05:55.246 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:05:55.246 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:05:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 msgr2=0x7f5f20068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 0x7f5f20068bf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5f380090b0 tx=0x7f5f38008030 comp rx=0 tx=0).stop 2024-09-13T18:05:55.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 msgr2=0x7f5f3c14c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400efc0 tx=0x7f5f3400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 shutdown_connections 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5f20066730 0x7f5f20068bf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5f3c0ca570 0x7f5f3c14d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0ca950 0x7f5f3c14c410 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 --2- 172.21.15.88:0/2900885310 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5f3c0c3c20 0x7f5f3c1e16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 >> 172.21.15.88:0/2900885310 conn(0x7f5f3c0cb3f0 msgr2=0x7f5f3c0cca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 shutdown_connections 2024-09-13T18:05:55.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.244+0000 7f5f43567700 1 -- 172.21.15.88:0/2900885310 wait complete. 2024-09-13T18:05:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:05:55.260 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-13T18:05:55.260 INFO:tasks.mon_thrash.mon_thrasher:seed: 1726250753, revive delay: 20.0, thrash delay: 10.0 thrash many: False, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-13T18:05:55.260 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:05:55.261 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:05:55.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 Processor -- start 2024-09-13T18:05:55.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 -- start start 2024-09-13T18:05:55.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7bc15a410 0x7fb7bc157970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc1574e0 con 0x7fb7bc151080 2024-09-13T18:05:55.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc0c4560 con 0x7fb7bc06f630 2024-09-13T18:05:55.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.360+0000 7fb7c1cf8700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c32b0 con 0x7fb7bc15a410 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7bb7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb7bc151080 0x7fb7bc0c54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46966/0 (socket says 172.21.15.88:46966) 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7bb7fe700 1 -- 172.21.15.88:0/399624141 learned_addr learned my addr 172.21.15.88:0/399624141 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7b3fff700 1 --2- 172.21.15.88:0/399624141 >> v2:172.21.15.94:3300/0 conn(0x7fb7bc15a410 0x7fb7bc157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7baffd700 1 -- 172.21.15.88:0/399624141 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539591995 0 0) 0x7fb7bc1574e0 con 0x7fb7bc151080 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7b3fff700 1 -- 172.21.15.88:0/399624141 >> v1:172.21.15.94:6789/0 conn(0x7fb7bc06f630 legacy=0x7fb7bc1617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7b3fff700 1 -- 172.21.15.88:0/399624141 >> v1:172.21.15.88:6789/0 conn(0x7fb7bc151080 legacy=0x7fb7bc0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7b3fff700 1 -- 172.21.15.88:0/399624141 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0c4840 con 0x7fb7bc15a410 2024-09-13T18:05:55.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7b3fff700 1 --2- 172.21.15.88:0/399624141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc15a410 0x7fb7bc157970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097d0 tx=0x7fb7a4009ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c38dfcb1af5d38e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7baffd700 1 -- 172.21.15.88:0/399624141 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a4004230 con 0x7fb7bc15a410 2024-09-13T18:05:55.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7baffd700 1 -- 172.21.15.88:0/399624141 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a4004390 con 0x7fb7bc15a410 2024-09-13T18:05:55.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7baffd700 1 -- 172.21.15.88:0/399624141 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a40036c0 con 0x7fb7bc15a410 2024-09-13T18:05:55.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/399624141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc15a410 msgr2=0x7fb7bc157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/399624141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc15a410 0x7fb7bc157970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb7a40097d0 tx=0x7fb7a4009ae0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/399624141 shutdown_connections 2024-09-13T18:05:55.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/399624141 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc15a410 0x7fb7bc157970 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/399624141 >> 172.21.15.88:0/399624141 conn(0x7fb7bc0ca790 msgr2=0x7fb7bc0caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/399624141 shutdown_connections 2024-09-13T18:05:55.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.364+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/399624141 wait complete. 2024-09-13T18:05:55.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 Processor -- start 2024-09-13T18:05:55.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 -- start start 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7bc06f630 0x7fb7bc0c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc151080 0x7fb7bc1469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc15a850 con 0x7fb7bc15a410 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc1f2df0 con 0x7fb7bc151080 2024-09-13T18:05:55.375 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.368+0000 7fb7c1cf8700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc1f2500 con 0x7fb7bc06f630 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44006/0 (socket says 172.21.15.88:44006) 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 -- 172.21.15.88:0/2231647354 learned_addr learned my addr 172.21.15.88:0/2231647354 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bb7fe700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7bc06f630 0x7fb7bc0c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7b3fff700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc151080 0x7fb7bc1469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 -- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7bc06f630 msgr2=0x7fb7bc0c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7bc06f630 0x7fb7bc0c8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 -- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc151080 msgr2=0x7fb7bc1469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc151080 0x7fb7bc1469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 -- 172.21.15.88:0/2231647354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40094b0 con 0x7fb7bc15a410 2024-09-13T18:05:55.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7bbfff700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4001fc0 tx=0x7fb7b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4003e50 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b400a840 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc1e2070 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400abd0 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc1f2a80 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.372+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc0c6f70 con 0x7fb7bc15a410 2024-09-13T18:05:55.378 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.376+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb7b400ad30 con 0x7fb7bc15a410 2024-09-13T18:05:55.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.376+0000 7fb7b8ff9700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 0x7fb79c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.376+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7b4083d10 con 0x7fb7bc15a410 2024-09-13T18:05:55.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.376+0000 7fb7bb7fe700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 0x7fb79c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.381 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.376+0000 7fb7bb7fe700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 0x7fb79c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac007b30 tx=0x7fb7ac007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.388 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.384+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb7b4089020 con 0x7fb7bc15a410 2024-09-13T18:05:55.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb7bc157950 con 0x7fb7bc15a410 2024-09-13T18:05:55.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7b8ff9700 1 -- 172.21.15.88:0/2231647354 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7fb7b4017020 con 0x7fb7bc15a410 2024-09-13T18:05:55.628 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":45,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:05:55.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 msgr2=0x7fb79c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 0x7fb79c068bf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac007b30 tx=0x7fb7ac007a80 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 msgr2=0x7fb7bc1eeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4001fc0 tx=0x7fb7b400a340 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 shutdown_connections 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb79c066730 0x7fb79c068bf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7bc15a410 0x7fb7bc1eeef0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7bc151080 0x7fb7bc1469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 --2- 172.21.15.88:0/2231647354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7bc06f630 0x7fb7bc0c8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 >> 172.21.15.88:0/2231647354 conn(0x7fb7bc0ca790 msgr2=0x7fb7bc0c6030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 shutdown_connections 2024-09-13T18:05:55.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.624+0000 7fb7c1cf8700 1 -- 172.21.15.88:0/2231647354 wait complete. 2024-09-13T18:05:55.642 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:05:55.642 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T18:05:55.642 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:05:55.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:05:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 Processor -- start 2024-09-13T18:05:55.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 -- start start 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7a00c1e00 0x7fb7a00c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a0156e50 con 0x7fb7a00c21e0 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7a01570f0 con 0x7fb7a015ad20 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79f59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a01573d0 con 0x7fb7a00c1e00 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79dd9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb7a00c21e0 0x7fb7a015a610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46970/0 (socket says 172.21.15.88:46970) 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79dd9b700 1 -- 172.21.15.88:0/2869214451 learned_addr learned my addr 172.21.15.88:0/2869214451 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:55.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79e59c700 1 --2- 172.21.15.88:0/2869214451 >> v2:172.21.15.94:3300/0 conn(0x7fb7a00c1e00 0x7fb7a00c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.748+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012013354 0 0) 0x7fb7a0156e50 con 0x7fb7a00c21e0 2024-09-13T18:05:55.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7880035d0 con 0x7fb7a00c21e0 2024-09-13T18:05:55.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238653612 0 0) 0x7fb7a01570f0 con 0x7fb7a015ad20 2024-09-13T18:05:55.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a0156e50 con 0x7fb7a015ad20 2024-09-13T18:05:55.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79e59c700 1 -- 172.21.15.88:0/2869214451 >> v1:172.21.15.94:6789/0 conn(0x7fb7a015ad20 legacy=0x7fb7a0150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79e59c700 1 -- 172.21.15.88:0/2869214451 >> v1:172.21.15.88:6789/0 conn(0x7fb7a00c21e0 legacy=0x7fb7a015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102354836 0 0) 0x7fb7880035d0 con 0x7fb7a00c21e0 2024-09-13T18:05:55.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79e59c700 1 -- 172.21.15.88:0/2869214451 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a01576b0 con 0x7fb7a00c1e00 2024-09-13T18:05:55.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79e59c700 1 --2- 172.21.15.88:0/2869214451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a00c1e00 0x7fb7a00c47c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb794009850 tx=0x7fb794009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39854495d29f53a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7900019f0 con 0x7fb7a00c1e00 2024-09-13T18:05:55.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794004030 con 0x7fb7a00c1e00 2024-09-13T18:05:55.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79d59a700 1 -- 172.21.15.88:0/2869214451 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940043c0 con 0x7fb7a00c1e00 2024-09-13T18:05:55.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 -- 172.21.15.88:0/2869214451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a00c1e00 msgr2=0x7fb7a00c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 --2- 172.21.15.88:0/2869214451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a00c1e00 0x7fb7a00c47c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb794009850 tx=0x7fb794009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:55.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 -- 172.21.15.88:0/2869214451 shutdown_connections 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 --2- 172.21.15.88:0/2869214451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a00c1e00 0x7fb7a00c47c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 -- 172.21.15.88:0/2869214451 >> 172.21.15.88:0/2869214451 conn(0x7fb7a00664b0 msgr2=0x7fb7a006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 -- 172.21.15.88:0/2869214451 shutdown_connections 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 -- 172.21.15.88:0/2869214451 wait complete. 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.752+0000 7fb79f59e700 1 Processor -- start 2024-09-13T18:05:55.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- start start 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7a00c1e00 0x7fb7a0141af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a015ad20 0x7fb7a01462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0143510 con 0x7fb7a00c21e0 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a015a200 con 0x7fb7a015ad20 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0142030 con 0x7fb7a00c1e00 2024-09-13T18:05:55.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44022/0 (socket says 172.21.15.88:44022) 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 -- 172.21.15.88:0/822146574 learned_addr learned my addr 172.21.15.88:0/822146574 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79ed9d700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a015ad20 0x7fb7a01462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79e59c700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7a00c1e00 0x7fb7a0141af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7a00c1e00 msgr2=0x7fb7a0141af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7a00c1e00 0x7fb7a0141af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a015ad20 msgr2=0x7fb7a01462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb7a015ad20 0x7fb7a01462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940094b0 con 0x7fb7a00c21e0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79dd9b700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7900018f0 tx=0x7fb79000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79000acf0 con 0x7fb7a00c21e0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000ae50 con 0x7fb7a00c21e0 2024-09-13T18:05:55.766 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7900072d0 con 0x7fb7a00c21e0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a0142280 con 0x7fb7a00c21e0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.756+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a0159f20 con 0x7fb7a00c21e0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79f59e700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 0x7fb7a0140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a0068400 con 0x7fb7a01ef8a0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79e59c700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 0x7fb7a0140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79e59c700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7a0072510 con 0x7fb7a01ef8a0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79e59c700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 0x7fb7a0140d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb794009850 tx=0x7fb794004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794020070 con 0x7fb7a01ef8a0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb790007430 con 0x7fb7a00c21e0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb7800667d0 0x7fb780068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb790083d30 con 0x7fb7a00c21e0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb794003c60 con 0x7fb7a01ef8a0 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 msgr2=0x7fb7a0140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.767 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 0x7fb7a0140d30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb794009850 tx=0x7fb794004770 comp rx=0 tx=0).stop 2024-09-13T18:05:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 msgr2=0x7fb7a0140d30 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb78effd700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01ef8a0 0x7fb7a0140d30 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb794009850 tx=0x7fb794004770 comp rx=0 tx=0).stop 2024-09-13T18:05:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79ed9d700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb7800667d0 0x7fb780068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.760+0000 7fb79ed9d700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb7800667d0 0x7fb780068c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb7980011e0 tx=0x7fb798009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 0x7fb7a0141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a014fd50 con 0x7fb7a01efc80 2024-09-13T18:05:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79e59c700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 0x7fb7a0141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79e59c700 1 -- 172.21.15.88:0/822146574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb7a006f6b0 con 0x7fb7a01efc80 2024-09-13T18:05:55.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79e59c700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 0x7fb7a0141270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb794009ba0 tx=0x7fb794011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79401bd00 con 0x7fb7a01efc80 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4783 (secure 0 0 0) 0x7fb79401be60 con 0x7fb7a01efc80 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 msgr2=0x7fb7a0141270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 0x7fb7a0141270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb794009ba0 tx=0x7fb794011000 comp rx=0 tx=0).stop 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 msgr2=0x7fb7a0141270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:55.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb78effd700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a01efc80 0x7fb7a0141270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:05:55.778 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 46, 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.779 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.780 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:05:55.781 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.782 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.783 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.784 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.785 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:05:55.786 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.788 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.789 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:05:55.790 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:05:55.791 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb7800667d0 msgr2=0x7fb780068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb7800667d0 0x7fb780068c90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb7980011e0 tx=0x7fb798009040 comp rx=0 tx=0).stop 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 msgr2=0x7fb7a01f0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79ed9d700 1 -- 172.21.15.88:0/822146574 reap_dead start 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb7900018f0 tx=0x7fb79000a340 comp rx=0 tx=0).stop 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 shutdown_connections 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 --2- 172.21.15.88:0/822146574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7a00c21e0 0x7fb7a01f0140 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 >> 172.21.15.88:0/822146574 conn(0x7fb7a00664b0 msgr2=0x7fb7a006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 shutdown_connections 2024-09-13T18:05:55.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.772+0000 7fb79f59e700 1 -- 172.21.15.88:0/822146574 wait complete. 2024-09-13T18:05:55.794 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:05:55.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:05:55.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:05:55.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 Processor -- start 2024-09-13T18:05:55.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 -- start start 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffa3806ddc0 0x7ffa38156e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806fc90 con 0x7ffa3806e1a0 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa380c1d30 con 0x7ffa380c24f0 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.908+0000 7ffa40410700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa380c3be0 con 0x7ffa3806ddc0 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ffa3806e1a0 0x7ffa3806f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46974/0 (socket says 172.21.15.88:46974) 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 -- 172.21.15.88:0/2870509610 learned_addr learned my addr 172.21.15.88:0/2870509610 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/2870509610 >> v2:172.21.15.94:3300/0 conn(0x7ffa3806ddc0 0x7ffa38156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137446069 0 0) 0x7ffa3806fc90 con 0x7ffa3806e1a0 2024-09-13T18:05:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa200035d0 con 0x7ffa3806e1a0 2024-09-13T18:05:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992138795 0 0) 0x7ffa200035d0 con 0x7ffa3806e1a0 2024-09-13T18:05:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 >> v2:172.21.15.94:3300/0 conn(0x7ffa3806ddc0 msgr2=0x7ffa38156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 --2- 172.21.15.88:0/2870509610 >> v2:172.21.15.94:3300/0 conn(0x7ffa3806ddc0 0x7ffa38156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 >> v1:172.21.15.94:6789/0 conn(0x7ffa380c24f0 legacy=0x7ffa381508a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380c4360 con 0x7ffa3806e1a0 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7ffa280019f0 con 0x7ffa3806e1a0 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 >> v1:172.21.15.88:6789/0 conn(0x7ffa3806e1a0 legacy=0x7ffa3806f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa20003a20 0x7ffa20003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 0x7ffa200048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa200050f0 0x7ffa2000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380c3be0 con 0x7ffa20004420 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2000bfa0 con 0x7ffa20003a20 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2000c160 con 0x7ffa200050f0 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 0x7ffa200048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.918 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa20003a20 0x7ffa20003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3e9ad700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa200050f0 0x7ffa2000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 -- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa200050f0 msgr2=0x7ffa2000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa200050f0 0x7ffa2000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 -- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa20003a20 msgr2=0x7ffa20003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa20003a20 0x7ffa20003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 -- 172.21.15.88:0/2870509610 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200035d0 con 0x7ffa20004420 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/2870509610 reap_dead start 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 0x7ffa200048f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa38070e20 tx=0x7ffa200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342d970a697b104 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280070d0 con 0x7ffa20004420 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28007230 con 0x7ffa20004420 2024-09-13T18:05:55.919 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa3d1aa700 1 -- 172.21.15.88:0/2870509610 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa280075c0 con 0x7ffa20004420 2024-09-13T18:05:55.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 -- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 msgr2=0x7ffa200048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 0x7ffa200048f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffa38070e20 tx=0x7ffa200058a0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.920 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 -- 172.21.15.88:0/2870509610 shutdown_connections 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 --2- 172.21.15.88:0/2870509610 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa20004420 0x7ffa200048f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 -- 172.21.15.88:0/2870509610 >> 172.21.15.88:0/2870509610 conn(0x7ffa380ca790 msgr2=0x7ffa380caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 -- 172.21.15.88:0/2870509610 shutdown_connections 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.912+0000 7ffa40410700 1 -- 172.21.15.88:0/2870509610 wait complete. 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.916+0000 7ffa40410700 1 Processor -- start 2024-09-13T18:05:55.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.916+0000 7ffa40410700 1 -- start start 2024-09-13T18:05:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa20004420 0x7ffa3806b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38155d00 0x7ffa3814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38145530 con 0x7ffa38156920 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38155870 con 0x7ffa38155d00 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38154c60 con 0x7ffa20004420 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3d9ab700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38155d00 0x7ffa3814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e1ac700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa20004420 0x7ffa3806b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44036/0 (socket says 172.21.15.88:44036) 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3d9ab700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38155d00 0x7ffa3814f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:50456/0 (socket says 172.21.15.88:50456) 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/990361929 learned_addr learned my addr 172.21.15.88:0/990361929 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa20004420 msgr2=0x7ffa3806b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffa20004420 0x7ffa3806b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38155d00 msgr2=0x7ffa3814f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38155d00 0x7ffa3814f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38154f40 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e9ad700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806f220 tx=0x7ffa3000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300050d0 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa30005250 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa38155220 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa300036a0 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3814fcd0 con 0x7ffa38156920 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 0x7ffa380c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa381550d0 con 0x7ffa380c74e0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.920+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 0x7ffa380c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa3e1ac700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa380c1fd0 con 0x7ffa380c74e0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ffa30003800 con 0x7ffa38156920 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 0x7ffa380c78c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c014cf0 tx=0x7ffa2c014dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa24066760 0x7ffa24068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa300836b0 con 0x7ffa38156920 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c0129b0 con 0x7ffa380c74e0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa24066760 0x7ffa24068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ffa2c012b10 con 0x7ffa380c74e0 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 msgr2=0x7ffa380c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 0x7ffa380c78c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c014cf0 tx=0x7ffa2c014dd0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 msgr2=0x7ffa380c78c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa36ffd700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa380c74e0 0x7ffa380c78c0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c014cf0 tx=0x7ffa2c014dd0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.924+0000 7ffa3d9ab700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa24066760 0x7ffa24068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa28001c30 tx=0x7ffa28009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 0x7ffa38140500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38067ae0 con 0x7ffa38140120 2024-09-13T18:05:55.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 0x7ffa38140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa3e1ac700 1 -- 172.21.15.88:0/990361929 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ffa380c4920 con 0x7ffa38140120 2024-09-13T18:05:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa3e1ac700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 0x7ffa38140500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c015010 tx=0x7ffa2c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:55.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c004240 con 0x7ffa38140120 2024-09-13T18:05:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4947 (secure 0 0 0) 0x7ffa2c029070 con 0x7ffa38140120 2024-09-13T18:05:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 msgr2=0x7ffa38140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 0x7ffa38140500 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c015010 tx=0x7ffa2c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 msgr2=0x7ffa38140500 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa36ffd700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffa38140120 0x7ffa38140500 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2024-09-13T18:05:55.942 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:05:55.943 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 46, 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.944 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.945 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.946 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:55.947 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:55.948 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:55.949 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.950 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:05:55.951 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.952 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.953 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.954 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.955 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.956 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:55.957 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:05:55.958 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:55.958 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:55.958 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:55.958 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:05:55.958 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa24066760 msgr2=0x7ffa24068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ffa24066760 0x7ffa24068c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffa28001c30 tx=0x7ffa28009000 comp rx=0 tx=0).stop 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 msgr2=0x7ffa380c6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa3e9ad700 1 -- 172.21.15.88:0/990361929 reap_dead start 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ffa3806f220 tx=0x7ffa3000e6c0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 shutdown_connections 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 --2- 172.21.15.88:0/990361929 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffa38156920 0x7ffa380c6fa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 >> 172.21.15.88:0/990361929 conn(0x7ffa380ca790 msgr2=0x7ffa3814c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:55.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 shutdown_connections 2024-09-13T18:05:55.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:55.936+0000 7ffa40410700 1 -- 172.21.15.88:0/990361929 wait complete. 2024-09-13T18:05:55.961 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:05:55.961 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:05:55.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:05:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 Processor -- start 2024-09-13T18:05:56.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 -- start start 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d80cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d80cc480 con 0x7f56d8152f70 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d815c800 con 0x7f56d80caae0 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56de2c4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d815cae0 con 0x7f56d80ca700 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56dc861700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f56d8152f70 0x7f56d806fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:46984/0 (socket says 172.21.15.88:46984) 2024-09-13T18:05:56.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.076+0000 7f56dc861700 1 -- 172.21.15.88:0/3929282503 learned_addr learned my addr 172.21.15.88:0/3929282503 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d7fff700 1 --2- 172.21.15.88:0/3929282503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d80cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166330827 0 0) 0x7f56d80cc480 con 0x7f56d8152f70 2024-09-13T18:05:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c40035d0 con 0x7f56d8152f70 2024-09-13T18:05:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723742480 0 0) 0x7f56d815c800 con 0x7f56d80caae0 2024-09-13T18:05:56.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56d80cc480 con 0x7f56d80caae0 2024-09-13T18:05:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d7fff700 1 -- 172.21.15.88:0/3929282503 >> v1:172.21.15.94:6789/0 conn(0x7f56d80caae0 legacy=0x7f56d80c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d7fff700 1 -- 172.21.15.88:0/3929282503 >> v1:172.21.15.88:6789/0 conn(0x7f56d8152f70 legacy=0x7f56d806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d7fff700 1 -- 172.21.15.88:0/3929282503 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d815cdc0 con 0x7f56d80ca700 2024-09-13T18:05:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d7fff700 1 --2- 172.21.15.88:0/3929282503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d80cbf40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009880 tx=0x7f56c0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a219523fd2fcbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0011830 con 0x7f56d80ca700 2024-09-13T18:05:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c0011990 con 0x7f56d80ca700 2024-09-13T18:05:56.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56d77fe700 1 -- 172.21.15.88:0/3929282503 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0011d20 con 0x7f56d80ca700 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 -- 172.21.15.88:0/3929282503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 msgr2=0x7f56d80cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 --2- 172.21.15.88:0/3929282503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d80cbf40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56c0009880 tx=0x7f56c0009b90 comp rx=0 tx=0).stop 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 -- 172.21.15.88:0/3929282503 shutdown_connections 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 --2- 172.21.15.88:0/3929282503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d80cbf40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 -- 172.21.15.88:0/3929282503 >> 172.21.15.88:0/3929282503 conn(0x7f56d80cf130 msgr2=0x7f56d80cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:56.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 -- 172.21.15.88:0/3929282503 shutdown_connections 2024-09-13T18:05:56.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.080+0000 7f56de2c4700 1 -- 172.21.15.88:0/3929282503 wait complete. 2024-09-13T18:05:56.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.084+0000 7f56de2c4700 1 Processor -- start 2024-09-13T18:05:56.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.084+0000 7f56de2c4700 1 -- start start 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d80caae0 0x7f56d80c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8152f70 0x7f56d81f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c7f40 con 0x7f56d8152f70 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c8fd0 con 0x7f56d80caae0 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80c6d50 con 0x7f56d80ca700 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56dc861700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8152f70 0x7f56d81f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d8156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:41128/0 (socket says 172.21.15.88:41128) 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 -- 172.21.15.88:0/827606611 learned_addr learned my addr 172.21.15.88:0/827606611 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56cffff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d80caae0 0x7f56d80c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d80caae0 msgr2=0x7f56d80c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d80caae0 0x7f56d80c8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8152f70 msgr2=0x7f56d81f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f56d8152f70 0x7f56d81f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c00094b0 con 0x7f56d80ca700 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d7fff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d8156dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56c00090b0 tx=0x7f56c0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001a8c0 con 0x7f56d80ca700 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c001e070 con 0x7f56d80ca700 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c001ac60 con 0x7f56d80ca700 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d80c78f0 con 0x7f56d80ca700 2024-09-13T18:05:56.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.088+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d80c6a10 con 0x7f56d80ca700 2024-09-13T18:05:56.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56de2c4700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 0x7f56d814ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d81f2740 con 0x7f56d8154a90 2024-09-13T18:05:56.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56cffff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 0x7f56d814ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56cffff700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56d815d380 con 0x7f56d8154a90 2024-09-13T18:05:56.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56cffff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 0x7f56d814ca80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56d815c220 tx=0x7f56c800fb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80052e0 con 0x7f56d8154a90 2024-09-13T18:05:56.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f56c0024400 con 0x7f56d80ca700 2024-09-13T18:05:56.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f56b80667d0 0x7f56b8068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c0084f60 con 0x7f56d80ca700 2024-09-13T18:05:56.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f56c8005440 con 0x7f56d8154a90 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 msgr2=0x7f56d814ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56dc861700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f56b80667d0 0x7f56b8068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 0x7f56d814ca80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f56d815c220 tx=0x7f56c800fb00 comp rx=0 tx=0).stop 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 msgr2=0x7f56d814ca80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.092+0000 7f56d57fa700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d8154a90 0x7f56d814ca80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.096+0000 7f56dc861700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f56b80667d0 0x7f56b8068c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f56d00012e0 tx=0x7f56d0001a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56de2c4700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 0x7f56d81ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d815c220 con 0x7f56d814cfc0 2024-09-13T18:05:56.107 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56cffff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 0x7f56d81ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56cffff700 1 -- 172.21.15.88:0/827606611 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f56d80c81b0 con 0x7f56d814cfc0 2024-09-13T18:05:56.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56cffff700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 0x7f56d81ee580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56d8068590 tx=0x7f56c8000fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8023070 con 0x7f56d814cfc0 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7f56c8027410 con 0x7f56d814cfc0 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 msgr2=0x7f56d81ee580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 0x7f56d81ee580 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f56d8068590 tx=0x7f56c8000fe0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 msgr2=0x7f56d81ee580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.104+0000 7f56d57fa700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d814cfc0 0x7f56d81ee580 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.110 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 8, 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 46, 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:05:56.111 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:05:56.112 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:05:56.113 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:05:56.114 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:05:56.115 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.116 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.117 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.118 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:05:56.119 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:05:56.120 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:05:56.121 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:05:56.122 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:05:56.123 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:05:56.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f56b80667d0 msgr2=0x7f56b8068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f56b80667d0 0x7f56b8068c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f56d00012e0 tx=0x7f56d0001a50 comp rx=0 tx=0).stop 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 msgr2=0x7f56d8156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 --2- 172.21.15.88:0/827606611 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d80ca700 0x7f56d8156dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56c00090b0 tx=0x7f56c0004770 comp rx=0 tx=0).stop 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56dc861700 1 -- 172.21.15.88:0/827606611 reap_dead start 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56dc861700 1 -- 172.21.15.88:0/827606611 reap_dead start 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 shutdown_connections 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 >> 172.21.15.88:0/827606611 conn(0x7f56d80cf130 msgr2=0x7f56d814f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 shutdown_connections 2024-09-13T18:05:56.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.108+0000 7f56de2c4700 1 -- 172.21.15.88:0/827606611 wait complete. 2024-09-13T18:05:56.127 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:05:56.127 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-13T18:05:56.127 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T18:05:56.127 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T18:05:56.128 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:05:56.128 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:05:56.128 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:05:56.184 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:05:56.184 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-13T18:05:56.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:05:56.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 Processor -- start 2024-09-13T18:05:56.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- start start 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f744c1533d0 0x7f744c06eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c0c6e80 con 0x7f744c06f3e0 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c15d190 con 0x7f744c0c6670 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744c0c5e50 con 0x7f744c1533d0 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744b7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f744c06f3e0 legacy=0x7f744c0c0f80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744affd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f744c1533d0 0x7f744c06eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f74427fc700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f744c0c6670 0x7f744c0c0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45348/0 (socket says 172.21.15.88:45348) 2024-09-13T18:05:56.304 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f74427fc700 1 -- 172.21.15.88:0/3235646846 learned_addr learned my addr 172.21.15.88:0/3235646846 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744affd700 1 -- 172.21.15.88:0/3235646846 >> v1:172.21.15.94:6789/0 conn(0x7f744c0c6670 legacy=0x7f744c0c0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744affd700 1 -- 172.21.15.88:0/3235646846 >> v1:172.21.15.88:6789/0 conn(0x7f744c06f3e0 legacy=0x7f744c0c0f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744a7fc700 1 -- 172.21.15.88:0/3235646846 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640685376 0 0) 0x7f744c15d190 con 0x7f744c0c6670 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744affd700 1 -- 172.21.15.88:0/3235646846 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c15d3c0 con 0x7f744c1533d0 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744affd700 1 --2- 172.21.15.88:0/3235646846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c1533d0 0x7f744c06eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f743c009850 tx=0x7f743c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e36161648f004fec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.305 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744a7fc700 1 -- 172.21.15.88:0/3235646846 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c004230 con 0x7f744c1533d0 2024-09-13T18:05:56.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744a7fc700 1 -- 172.21.15.88:0/3235646846 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c004390 con 0x7f744c1533d0 2024-09-13T18:05:56.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744a7fc700 1 -- 172.21.15.88:0/3235646846 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0036c0 con 0x7f744c1533d0 2024-09-13T18:05:56.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- 172.21.15.88:0/3235646846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c1533d0 msgr2=0x7f744c06eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.306 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 --2- 172.21.15.88:0/3235646846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c1533d0 0x7f744c06eea0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f743c009850 tx=0x7f743c009b60 comp rx=0 tx=0).stop 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- 172.21.15.88:0/3235646846 shutdown_connections 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 --2- 172.21.15.88:0/3235646846 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c1533d0 0x7f744c06eea0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- 172.21.15.88:0/3235646846 >> 172.21.15.88:0/3235646846 conn(0x7f744c070a40 msgr2=0x7f744c0caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- 172.21.15.88:0/3235646846 shutdown_connections 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.300+0000 7f744bfff700 1 -- 172.21.15.88:0/3235646846 wait complete. 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 Processor -- start 2024-09-13T18:05:56.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 -- start start 2024-09-13T18:05:56.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 0x7f744c0c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 0x7f744c0c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14f440 con 0x7f744c0c6670 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14e8c0 con 0x7f744c06f3e0 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14eba0 con 0x7f744c1533d0 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f74427fc700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 msgr2=0x7f744c0c23d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f74427fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 0x7f744c0c23d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744b7fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 0x7f744c0c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744affd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:50564/0 (socket says 172.21.15.88:50564) 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.304+0000 7f744affd700 1 -- 172.21.15.88:0/2249577450 learned_addr learned my addr 172.21.15.88:0/2249577450 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 -- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 msgr2=0x7f744c0c2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 0x7f744c0c2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 -- 172.21.15.88:0/2249577450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 msgr2=0x7f744c0c23d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 0x7f744c0c23d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 -- 172.21.15.88:0/2249577450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c0094b0 con 0x7f744c06f3e0 2024-09-13T18:05:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744b7fe700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 0x7f744c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:56.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744affd700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f743c0090b0 tx=0x7f743c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c006ea0 con 0x7f744c06f3e0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c01f070 con 0x7f744c06f3e0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c14ee80 con 0x7f744c06f3e0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c011850 con 0x7f744c06f3e0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c14d550 con 0x7f744c06f3e0 2024-09-13T18:05:56.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c14d770 con 0x7f744c06f3e0 2024-09-13T18:05:56.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.308+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f743c021030 con 0x7f744c06f3e0 2024-09-13T18:05:56.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.312+0000 7f7443fff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 0x7f742c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:56.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.312+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f743c0858a0 con 0x7f744c06f3e0 2024-09-13T18:05:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.312+0000 7f74427fc700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 0x7f742c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:56.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.312+0000 7f74427fc700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 0x7f742c068bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f744c0c5830 tx=0x7f7434007ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:56.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.320+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f743c052b90 con 0x7f744c06f3e0 2024-09-13T18:05:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.560+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f744c14d770 con 0x7f744c06f3e0 2024-09-13T18:05:56.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.560+0000 7f7443fff700 1 -- 172.21.15.88:0/2249577450 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f743c0561b0 con 0x7f744c06f3e0 2024-09-13T18:05:56.565 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":46,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 msgr2=0x7f742c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 0x7f742c068bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f744c0c5830 tx=0x7f7434007ab0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 msgr2=0x7f744c150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f743c0090b0 tx=0x7f743c004770 comp rx=0 tx=0).stop 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 shutdown_connections 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f742c066710 0x7f742c068bd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f744c1533d0 0x7f744c0c2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f744c0c6670 0x7f744c0c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 --2- 172.21.15.88:0/2249577450 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f744c06f3e0 0x7f744c150fe0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 >> 172.21.15.88:0/2249577450 conn(0x7f744c070a40 msgr2=0x7f744c06de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 shutdown_connections 2024-09-13T18:05:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:56.564+0000 7f744bfff700 1 -- 172.21.15.88:0/2249577450 wait complete. 2024-09-13T18:05:59.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:05:59.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 Processor -- start 2024-09-13T18:05:59.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- start start 2024-09-13T18:05:59.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.704 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 0x7f10d0071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10d00c1f70 0x7f10d0071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d00c1db0 con 0x7f10d01613e0 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d0160f50 con 0x7f10d00c1f70 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00c5b40 con 0x7f10d01574b0 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d4bc4700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 msgr2=0x7f10d0071720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d4bc4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 0x7f10d0071720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:41226/0 (socket says 172.21.15.88:41226) 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 -- 172.21.15.88:0/1365464543 learned_addr learned my addr 172.21.15.88:0/1365464543 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:59.705 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d5bc6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f10d00c1f70 0x7f10d0071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 -- 172.21.15.88:0/1365464543 >> v2:172.21.15.94:3300/0 conn(0x7f10d00c1f70 msgr2=0x7f10d0071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 --2- 172.21.15.88:0/1365464543 >> v2:172.21.15.94:3300/0 conn(0x7f10d00c1f70 0x7f10d0071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 -- 172.21.15.88:0/1365464543 >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 msgr2=0x7f10d0071720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 --2- 172.21.15.88:0/1365464543 >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 0x7f10d0071720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 -- 172.21.15.88:0/1365464543 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00c1630 con 0x7f10d01574b0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d53c5700 1 --2- 172.21.15.88:0/1365464543 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009910 tx=0x7f10c4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e01acdd07f37c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10cffff700 1 -- 172.21.15.88:0/1365464543 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011830 con 0x7f10d01574b0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10cffff700 1 -- 172.21.15.88:0/1365464543 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c4011990 con 0x7f10d01574b0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10cffff700 1 -- 172.21.15.88:0/1365464543 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c4011d40 con 0x7f10d01574b0 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- 172.21.15.88:0/1365464543 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 msgr2=0x7f10d00c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:59.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- 172.21.15.88:0/1365464543 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009910 tx=0x7f10c4009c20 comp rx=0 tx=0).stop 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- 172.21.15.88:0/1365464543 shutdown_connections 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- 172.21.15.88:0/1365464543 >> v2:172.21.15.94:3300/0 conn(0x7f10d00c1f70 0x7f10d0071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- 172.21.15.88:0/1365464543 >> v2:172.21.15.88:3300/0 conn(0x7f10d01613e0 0x7f10d0071720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 --2- 172.21.15.88:0/1365464543 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d00c5600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- 172.21.15.88:0/1365464543 >> 172.21.15.88:0/1365464543 conn(0x7f10d00ca720 msgr2=0x7f10d00cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- 172.21.15.88:0/1365464543 shutdown_connections 2024-09-13T18:05:59.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.700+0000 7f10d63c7700 1 -- 172.21.15.88:0/1365464543 wait complete. 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 Processor -- start 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- start start 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 0x7f10d006be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 0x7f10d0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00ca100 con 0x7f10d00c1f70 2024-09-13T18:05:59.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d015cf20 con 0x7f10d01613e0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00c9a40 con 0x7f10d01574b0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d53c5700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 msgr2=0x7f10d006be00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d53c5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 0x7f10d006be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d5bc6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 0x7f10d0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:41232/0 (socket says 172.21.15.88:41232) 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 -- 172.21.15.88:0/2965533819 learned_addr learned my addr 172.21.15.88:0/2965533819 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 -- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 msgr2=0x7f10d0149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 0x7f10d0149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 -- 172.21.15.88:0/2965533819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 msgr2=0x7f10d006be00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 0x7f10d006be00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 -- 172.21.15.88:0/2965533819 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c4009570 con 0x7f10d01574b0 2024-09-13T18:05:59.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d5bc6700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 0x7f10d0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d4bc4700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10c000b9e0 tx=0x7f10c000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c000c9b0 con 0x7f10d01574b0 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c000cb30 con 0x7f10d01574b0 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c0015470 con 0x7f10d01574b0 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d00c9d20 con 0x7f10d01574b0 2024-09-13T18:05:59.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.704+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d015e310 con 0x7f10d01574b0 2024-09-13T18:05:59.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d0157890 con 0x7f10d01574b0 2024-09-13T18:05:59.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f10c0012070 con 0x7f10d01574b0 2024-09-13T18:05:59.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10cdffb700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 0x7f10bc068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:05:59.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10c0083ee0 con 0x7f10d01574b0 2024-09-13T18:05:59.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10d53c5700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 0x7f10bc068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:05:59.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.708+0000 7f10d53c5700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 0x7f10bc068bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10c4000c00 tx=0x7f10c4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:05:59.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.720+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f10c00511d0 con 0x7f10d01574b0 2024-09-13T18:05:59.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.952+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f10d00c56f0 con 0x7f10d01574b0 2024-09-13T18:05:59.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.952+0000 7f10cdffb700 1 -- 172.21.15.88:0/2965533819 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f10c00547f0 con 0x7f10d01574b0 2024-09-13T18:05:59.957 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":50,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 msgr2=0x7f10bc068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 0x7f10bc068bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f10c4000c00 tx=0x7f10c4008030 comp rx=0 tx=0).stop 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 msgr2=0x7f10d01f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f10c000b9e0 tx=0x7f10c000bcf0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 shutdown_connections 2024-09-13T18:05:59.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f10bc066710 0x7f10bc068bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f10d01574b0 0x7f10d01f61f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f10d01613e0 0x7f10d0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 --2- 172.21.15.88:0/2965533819 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10d00c1f70 0x7f10d006be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 >> 172.21.15.88:0/2965533819 conn(0x7f10d00ca720 msgr2=0x7f10d01551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 shutdown_connections 2024-09-13T18:05:59.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:05:59.956+0000 7f10d63c7700 1 -- 172.21.15.88:0/2965533819 wait complete. 2024-09-13T18:06:02.972 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:03.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 Processor -- start 2024-09-13T18:06:03.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 -- start start 2024-09-13T18:06:03.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 0x7f785c167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0c1db0 con 0x7f785c1574b0 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785c160f50 con 0x7f785c0c1f70 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f7860975700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0c5b40 con 0x7f785c1613e0 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785b7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f785c1574b0 legacy=0x7f785c071720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785bfff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 msgr2=0x7f785c167ad0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 0x7f785c167ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:42502/0 (socket says 172.21.15.88:42502) 2024-09-13T18:06:03.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 -- 172.21.15.88:0/3757503327 learned_addr learned my addr 172.21.15.88:0/3757503327 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 -- 172.21.15.88:0/3757503327 >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 msgr2=0x7f785c167ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 --2- 172.21.15.88:0/3757503327 >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 0x7f785c167ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 -- 172.21.15.88:0/3757503327 >> v1:172.21.15.88:6789/0 conn(0x7f785c1574b0 legacy=0x7f785c071720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 -- 172.21.15.88:0/3757503327 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0c1630 con 0x7f785c1613e0 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785affd700 1 --2- 172.21.15.88:0/3757503327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f785c0c1820 tx=0x7f785400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a7c5593e7c2d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785a7fc700 1 -- 172.21.15.88:0/3757503327 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400e070 con 0x7f785c1613e0 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785a7fc700 1 -- 172.21.15.88:0/3757503327 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400b940 con 0x7f785c1613e0 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.088+0000 7f785a7fc700 1 -- 172.21.15.88:0/3757503327 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400bcf0 con 0x7f785c1613e0 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- 172.21.15.88:0/3757503327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 msgr2=0x7f785c0c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- 172.21.15.88:0/3757503327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f785c0c1820 tx=0x7f785400b330 comp rx=0 tx=0).stop 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- 172.21.15.88:0/3757503327 shutdown_connections 2024-09-13T18:06:03.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- 172.21.15.88:0/3757503327 >> v2:172.21.15.88:3300/0 conn(0x7f785c0c1f70 0x7f785c167ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- 172.21.15.88:0/3757503327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1613e0 0x7f785c0c5600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- 172.21.15.88:0/3757503327 >> 172.21.15.88:0/3757503327 conn(0x7f785c0ca720 msgr2=0x7f785c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- 172.21.15.88:0/3757503327 shutdown_connections 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- 172.21.15.88:0/3757503327 wait complete. 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 Processor -- start 2024-09-13T18:06:03.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- start start 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 0x7f785c160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 0x7f785c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c06c3e0 con 0x7f785c1613e0 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c15f2d0 con 0x7f785c0c1f70 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f7860975700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c1e8e80 con 0x7f785c1574b0 2024-09-13T18:06:03.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785bfff700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 msgr2=0x7f785c0c9c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 0x7f785c0c9c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785affd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 0x7f785c160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785b7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:49278/0 (socket says 172.21.15.88:49278) 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.092+0000 7f785b7fe700 1 -- 172.21.15.88:0/217574797 learned_addr learned my addr 172.21.15.88:0/217574797 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 -- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 msgr2=0x7f785c160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 0x7f785c160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 -- 172.21.15.88:0/217574797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 msgr2=0x7f785c0c9c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 0x7f785c0c9c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 -- 172.21.15.88:0/217574797 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009b30 con 0x7f785c0c1f70 2024-09-13T18:06:03.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785affd700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 0x7f785c160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f785b7fe700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784400b780 tx=0x7f784400ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844003e70 con 0x7f785c0c1f70 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844005070 con 0x7f785c0c1f70 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c1e8440 con 0x7f785c0c1f70 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844005420 con 0x7f785c0c1f70 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c15f830 con 0x7f785c0c1f70 2024-09-13T18:06:03.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0c5920 con 0x7f785c0c1f70 2024-09-13T18:06:03.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.096+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7844005580 con 0x7f785c0c1f70 2024-09-13T18:06:03.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.100+0000 7f7853fff700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 0x7f7840068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:03.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.100+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7844084540 con 0x7f785c0c1f70 2024-09-13T18:06:03.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.100+0000 7f785affd700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 0x7f7840068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:03.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.100+0000 7f785affd700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 0x7f7840068bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f785c0c1820 tx=0x7f7854009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:03.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.104+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7844051990 con 0x7f785c0c1f70 2024-09-13T18:06:03.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.336+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f785c0c6620 con 0x7f785c0c1f70 2024-09-13T18:06:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.336+0000 7f7853fff700 1 -- 172.21.15.88:0/217574797 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f7844005830 con 0x7f785c0c1f70 2024-09-13T18:06:03.341 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":53,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 msgr2=0x7f7840068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 0x7f7840068bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f785c0c1820 tx=0x7f7854009000 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 msgr2=0x7f785c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784400b780 tx=0x7f784400ba90 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 shutdown_connections 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7840066710 0x7f7840068bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f785c1574b0 0x7f785c160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f785c1613e0 0x7f785c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 --2- 172.21.15.88:0/217574797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f785c0c1f70 0x7f785c06c6a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 >> 172.21.15.88:0/217574797 conn(0x7f785c0ca720 msgr2=0x7f785c150be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 shutdown_connections 2024-09-13T18:06:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:03.340+0000 7f7860975700 1 -- 172.21.15.88:0/217574797 wait complete. 2024-09-13T18:06:03.620 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:06:03.622 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:06:06.362 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:06.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.476+0000 7f886f59e700 1 Processor -- start 2024-09-13T18:06:06.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886f59e700 1 -- start start 2024-09-13T18:06:06.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:06.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886e59c700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f88700c7d40 legacy=0x7f8870150b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886f59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8870066680 con 0x7f88700c7d40 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886f59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88700c62c0 con 0x7f8870070600 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887006c1d0 con 0x7f88700c8120 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f8867fff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f8870070600 0x7f887015f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:34308/0 (socket says 172.21.15.88:34308) 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f8867fff700 1 -- 172.21.15.88:0/3151078511 learned_addr learned my addr 172.21.15.88:0/3151078511 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:06.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.480+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:06.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v1:172.21.15.88:6789/0 conn(0x7f88700c7d40 legacy=0x7f8870150b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:06.688 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:06.683+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:07.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v1:172.21.15.88:6789/0 conn(0x7f88700c7d40 legacy=0x7f8870150b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:07.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:07.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.087+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v1:172.21.15.88:6789/0 conn(0x7f88700c7d40 legacy=0x7f8870150b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:07.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:07.891+0000 7f886ed9d700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 msgr2=0x7f88700c6730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88700c8120 0x7f88700c6730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 -- 172.21.15.88:0/3151078511 >> v1:172.21.15.94:6789/0 conn(0x7f8870070600 legacy=0x7f887015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 -- 172.21.15.88:0/3151078511 >> v1:172.21.15.88:6789/0 conn(0x7f88700c7d40 legacy=0x7f8870150b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 -- 172.21.15.88:0/3151078511 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006c1d0 con 0x7f8850006210 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886cd99700 1 -- 172.21.15.88:0/3151078511 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8850008d80 con 0x7f8850003760 2024-09-13T18:06:09.486 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f8867fff700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 msgr2=0x7f88500086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f8867fff700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:09.487 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.483+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f8867fff700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 msgr2=0x7f88500086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f8867fff700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:09.691 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:09.692 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:09.687+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f8867fff700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 msgr2=0x7f88500086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f8867fff700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:10.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 msgr2=0x7f8850005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:10.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.091+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:10.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f8867fff700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 msgr2=0x7f88500086d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:10.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f8867fff700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:06:10.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.94:3300/0 conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:10.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 msgr2=0x7f88500086d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:10.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> v2:172.21.15.88:3300/0 conn(0x7f8850006210 0x7f88500086d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:10.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886e59c700 1 -- 172.21.15.88:0/3151078511 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887006c4b0 con 0x7f8850003760 2024-09-13T18:06:10.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886e59c700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8850003760 0x7f8850005bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8870072040 tx=0x7f886000b6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e511c8325099734 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:10.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886dd9b700 1 -- 172.21.15.88:0/3151078511 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860016610 con 0x7f8850003760 2024-09-13T18:06:10.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886dd9b700 1 -- 172.21.15.88:0/3151078511 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860011050 con 0x7f8850003760 2024-09-13T18:06:10.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886dd9b700 1 -- 172.21.15.88:0/3151078511 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860016990 con 0x7f8850003760 2024-09-13T18:06:10.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886f59e700 1 -- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8850003760 msgr2=0x7f8850005bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:10.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886f59e700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8850003760 0x7f8850005bc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8870072040 tx=0x7f886000b6d0 comp rx=0 tx=0).stop 2024-09-13T18:06:10.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886ed9d700 1 -- 172.21.15.88:0/3151078511 reap_dead start 2024-09-13T18:06:10.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.895+0000 7f886f59e700 1 -- 172.21.15.88:0/3151078511 shutdown_connections 2024-09-13T18:06:10.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 --2- 172.21.15.88:0/3151078511 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8850003760 0x7f8850005bc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:10.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 -- 172.21.15.88:0/3151078511 >> 172.21.15.88:0/3151078511 conn(0x7f887006a300 msgr2=0x7f8870070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:10.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 -- 172.21.15.88:0/3151078511 shutdown_connections 2024-09-13T18:06:10.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 -- 172.21.15.88:0/3151078511 wait complete. 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 Processor -- start 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.899+0000 7f886f59e700 1 -- start start 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 0x7f88701eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 0x7f88701529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870155410 con 0x7f8850003760 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88701594e0 con 0x7f88701537e0 2024-09-13T18:06:10.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8870159780 con 0x7f8870158700 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886e59c700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 msgr2=0x7f88701eeee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886e59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 0x7f88701eeee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886ed9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 0x7f88701529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:33936/0 (socket says 172.21.15.88:33936) 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 -- 172.21.15.88:0/498045957 learned_addr learned my addr 172.21.15.88:0/498045957 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 -- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 msgr2=0x7f88701529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 0x7f88701529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 -- 172.21.15.88:0/498045957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 msgr2=0x7f88701eeee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 0x7f88701eeee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 -- 172.21.15.88:0/498045957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860009a20 con 0x7f88701537e0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886ed9d700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 0x7f88701529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8867fff700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f885800c730 tx=0x7f885800ca40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858005d90 con 0x7f88701537e0 2024-09-13T18:06:10.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88580070d0 con 0x7f88701537e0 2024-09-13T18:06:10.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858007440 con 0x7f88701537e0 2024-09-13T18:06:10.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.903+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870159a60 con 0x7f88701537e0 2024-09-13T18:06:10.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.907+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887015a020 con 0x7f88701537e0 2024-09-13T18:06:10.912 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.907+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88701ef420 con 0x7f88701537e0 2024-09-13T18:06:10.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.907+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f88580075a0 con 0x7f88701537e0 2024-09-13T18:06:10.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.907+0000 7f8866ffd700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 0x7f88500698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:10.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.911+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8858083560 con 0x7f88701537e0 2024-09-13T18:06:10.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.911+0000 7f886e59c700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 0x7f88500698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:10.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.911+0000 7f886e59c700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 0x7f88500698a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f886000b710 tx=0x7f886000d030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:10.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:10.919+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f88580508f0 con 0x7f88701537e0 2024-09-13T18:06:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.155+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f8870066300 con 0x7f88701537e0 2024-09-13T18:06:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.155+0000 7f8866ffd700 1 -- 172.21.15.88:0/498045957 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1533 (secure 0 0 0) 0x7f8858053f10 con 0x7f88701537e0 2024-09-13T18:06:11.161 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":10,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 msgr2=0x7f88500698a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 0x7f88500698a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f886000b710 tx=0x7f886000d030 comp rx=0 tx=0).stop 2024-09-13T18:06:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 msgr2=0x7f88700c1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f885800c730 tx=0x7f885800ca40 comp rx=0 tx=0).stop 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 shutdown_connections 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f88500673e0 0x7f88500698a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8870158700 0x7f88701529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88701537e0 0x7f88700c1830 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 --2- 172.21.15.88:0/498045957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8850003760 0x7f88701eeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 >> 172.21.15.88:0/498045957 conn(0x7f887006a300 msgr2=0x7f88701540b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 shutdown_connections 2024-09-13T18:06:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.159+0000 7f886f59e700 1 -- 172.21.15.88:0/498045957 wait complete. 2024-09-13T18:06:11.177 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-13T18:06:11.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-13T18:06:11.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:06:11.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 Processor -- start 2024-09-13T18:06:11.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 -- start start 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f0155ba0 0x7fc9f014fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f006ce90 con 0x7fc9f006bfd0 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f006d170 con 0x7fc9f00c1570 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9f4b1e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f006d450 con 0x7fc9f0155ba0 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9eeffd700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fc9f0155ba0 msgr2=0x7fc9f014fa40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9ef7fe700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fc9f006bfd0 legacy=0x7fc9f006c3b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9eeffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc9f0155ba0 0x7fc9f014fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9effff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fc9f00c1570 0x7fc9f00c2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45682/0 (socket says 172.21.15.88:45682) 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9effff700 1 -- 172.21.15.88:0/1043878633 learned_addr learned my addr 172.21.15.88:0/1043878633 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050395358 0 0) 0x7fc9f006d170 con 0x7fc9f00c1570 2024-09-13T18:06:11.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9dc0035d0 con 0x7fc9f00c1570 2024-09-13T18:06:11.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2527069998 0 0) 0x7fc9dc0035d0 con 0x7fc9f00c1570 2024-09-13T18:06:11.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.283+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 >> v2:172.21.15.88:3300/0 conn(0x7fc9f0155ba0 msgr2=0x7fc9f014fa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:11.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 --2- 172.21.15.88:0/1043878633 >> v2:172.21.15.88:3300/0 conn(0x7fc9f0155ba0 0x7fc9f014fa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 >> v1:172.21.15.88:6789/0 conn(0x7fc9f006bfd0 legacy=0x7fc9f006c3b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f006d730 con 0x7fc9f00c1570 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fc9e8001670 con 0x7fc9f00c1570 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 >> v1:172.21.15.94:6789/0 conn(0x7fc9f00c1570 legacy=0x7fc9f00c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9dc003a20 0x7fc9dc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9dc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9dc005350 0x7fc9dc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f006d450 con 0x7fc9dc003a20 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc00e460 con 0x7fc9dc004870 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9dc00e620 con 0x7fc9dc005350 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ef7fe700 1 -- 172.21.15.88:0/1043878633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9dc003a20 msgr2=0x7fc9dc003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ef7fe700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9dc003a20 0x7fc9dc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9dc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9effff700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9dc005350 0x7fc9dc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 -- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9dc005350 msgr2=0x7fc9dc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9dc005350 0x7fc9dc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 -- 172.21.15.88:0/1043878633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9dc003a20 msgr2=0x7fc9dc003e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9dc003a20 0x7fc9dc003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 -- 172.21.15.88:0/1043878633 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc0035d0 con 0x7fc9dc004870 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9effff700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9dc005350 0x7fc9dc00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9effff700 1 -- 172.21.15.88:0/1043878633 reap_dead start 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9dc004cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003db0 tx=0x7fc9dc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e38ac1fc4763c261 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8009860 con 0x7fc9dc004870 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d800bd60 con 0x7fc9dc004870 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9ee7fc700 1 -- 172.21.15.88:0/1043878633 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8015640 con 0x7fc9dc004870 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 msgr2=0x7fc9dc004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9dc004cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003db0 tx=0x7fc9dc0058a0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/1043878633 shutdown_connections 2024-09-13T18:06:11.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/1043878633 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9dc004cf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/1043878633 >> 172.21.15.88:0/1043878633 conn(0x7fc9f00664b0 msgr2=0x7fc9f006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:11.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/1043878633 shutdown_connections 2024-09-13T18:06:11.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.287+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/1043878633 wait complete. 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 Processor -- start 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- start start 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9f0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f0145090 0x7fc9f014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9f014b940 0x7fc9f00c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f014afb0 con 0x7fc9f0145090 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c4b30 con 0x7fc9dc004870 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c4900 con 0x7fc9f014b940 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9eeffd700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f0145090 msgr2=0x7fc9f014b400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9eeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f0145090 0x7fc9f014b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:11.298 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9f0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9effff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9f014b940 0x7fc9f00c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9f0159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:33960/0 (socket says 172.21.15.88:33960) 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 -- 172.21.15.88:0/567843264 learned_addr learned my addr 172.21.15.88:0/567843264 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9f014b940 msgr2=0x7fc9f00c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc9f014b940 0x7fc9f00c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f0145090 msgr2=0x7fc9f014b400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc9f0145090 0x7fc9f014b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f0159c60 con 0x7fc9dc004870 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9ef7fe700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9f0159720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b7b0 tx=0x7fc9e000bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00050d0 con 0x7fc9dc004870 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e0005250 con 0x7fc9dc004870 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0005600 con 0x7fc9dc004870 2024-09-13T18:06:11.299 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f014bdc0 con 0x7fc9dc004870 2024-09-13T18:06:11.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.291+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00c6e90 con 0x7fc9dc004870 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 0x7fc9f00c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00c64f0 con 0x7fc9f0145490 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 0x7fc9f00c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9eeffd700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc9f006b6f0 con 0x7fc9f0145490 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc9e0005760 con 0x7fc9dc004870 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 0x7fc9f00c5fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003db0 tx=0x7fc9d8005e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.301 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc9d00666e0 0x7fc9d0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9e0083b00 con 0x7fc9dc004870 2024-09-13T18:06:11.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9effff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc9d00666e0 0x7fc9d0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8024070 con 0x7fc9f0145490 2024-09-13T18:06:11.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fc9d800bed0 con 0x7fc9f0145490 2024-09-13T18:06:11.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 msgr2=0x7fc9f00c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 0x7fc9f00c5fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8003db0 tx=0x7fc9d8005e40 comp rx=0 tx=0).stop 2024-09-13T18:06:11.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 msgr2=0x7fc9f00c5fb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:11.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9e7fff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f0145490 0x7fc9f00c5fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.303 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.295+0000 7fc9effff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc9d00666e0 0x7fc9d0068ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00c4cf0 tx=0x7fc9e8001e50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 0x7fc9f00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0068400 con 0x7fc9f00c5260 2024-09-13T18:06:11.311 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 0x7fc9f00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9eeffd700 1 -- 172.21.15.88:0/567843264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fc9f00c5bb0 con 0x7fc9f00c5260 2024-09-13T18:06:11.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9eeffd700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 0x7fc9f00c5670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f80 tx=0x7fc9d8006f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.313 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d8016ea0 con 0x7fc9f00c5260 2024-09-13T18:06:11.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4938 (secure 0 0 0) 0x7fc9d8033400 con 0x7fc9f00c5260 2024-09-13T18:06:11.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 msgr2=0x7fc9f00c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 0x7fc9f00c5670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8000f80 tx=0x7fc9d8006f90 comp rx=0 tx=0).stop 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 msgr2=0x7fc9f00c5670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.307+0000 7fc9e7fff700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9f00c5260 0x7fc9f00c5670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 10, 2024-09-13T18:06:11.317 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.318 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.319 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:11.320 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.321 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.322 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.324 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.325 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.326 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.327 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:11.328 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:11.329 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.330 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.331 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:11.331 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:11.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc9d00666e0 msgr2=0x7fc9d0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc9d00666e0 0x7fc9d0068ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00c4cf0 tx=0x7fc9e8001e50 comp rx=0 tx=0).stop 2024-09-13T18:06:11.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 msgr2=0x7fc9f0159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 --2- 172.21.15.88:0/567843264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc9dc004870 0x7fc9f0159720 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000b7b0 tx=0x7fc9e000bac0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9effff700 1 -- 172.21.15.88:0/567843264 reap_dead start 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9effff700 1 -- 172.21.15.88:0/567843264 reap_dead start 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 shutdown_connections 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 >> 172.21.15.88:0/567843264 conn(0x7fc9f00664b0 msgr2=0x7fc9f0154970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 shutdown_connections 2024-09-13T18:06:11.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.311+0000 7fc9f4b1e700 1 -- 172.21.15.88:0/567843264 wait complete. 2024-09-13T18:06:11.333 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:06:11.333 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-13T18:06:11.334 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:06:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 Processor -- start 2024-09-13T18:06:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- start start 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 0x7f19f0071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 0x7f19f01571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f015e370 con 0x7f19f006c170 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f015df50 con 0x7f19f00719b0 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015d3a0 con 0x7f19f00c5090 2024-09-13T18:06:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f5c7d700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 msgr2=0x7f19f01571b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f5c7d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 0x7f19f01571b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 0x7f19f0071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f547c700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f19f006c170 0x7f19f006c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45694/0 (socket says 172.21.15.88:45694) 2024-09-13T18:06:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f547c700 1 -- 172.21.15.88:0/4206107804 learned_addr learned my addr 172.21.15.88:0/4206107804 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:11.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19effff700 1 -- 172.21.15.88:0/4206107804 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279672961 0 0) 0x7f19f015e370 con 0x7f19f006c170 2024-09-13T18:06:11.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19effff700 1 -- 172.21.15.88:0/4206107804 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19dc0035d0 con 0x7f19f006c170 2024-09-13T18:06:11.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 -- 172.21.15.88:0/4206107804 >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 msgr2=0x7f19f01571b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:11.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/4206107804 >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 0x7f19f01571b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 -- 172.21.15.88:0/4206107804 >> v1:172.21.15.94:6789/0 conn(0x7f19f006c170 legacy=0x7f19f006c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 -- 172.21.15.88:0/4206107804 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00c1660 con 0x7f19f00c5090 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/4206107804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 0x7f19f0071470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4884e2d5767e2333 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19effff700 1 -- 172.21.15.88:0/4206107804 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d800e070 con 0x7f19f00c5090 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19effff700 1 -- 172.21.15.88:0/4206107804 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d800bb20 con 0x7f19f00c5090 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19effff700 1 -- 172.21.15.88:0/4206107804 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8012430 con 0x7f19f00c5090 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- 172.21.15.88:0/4206107804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 msgr2=0x7f19f0071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 --2- 172.21.15.88:0/4206107804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 0x7f19f0071470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d800b330 comp rx=0 tx=0).stop 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- 172.21.15.88:0/4206107804 shutdown_connections 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 --2- 172.21.15.88:0/4206107804 >> v2:172.21.15.88:3300/0 conn(0x7f19f00719b0 0x7f19f01571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 --2- 172.21.15.88:0/4206107804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c5090 0x7f19f0071470 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- 172.21.15.88:0/4206107804 >> 172.21.15.88:0/4206107804 conn(0x7f19f00664b0 msgr2=0x7f19f006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.447+0000 7f19f647e700 1 -- 172.21.15.88:0/4206107804 shutdown_connections 2024-09-13T18:06:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 -- 172.21.15.88:0/4206107804 wait complete. 2024-09-13T18:06:11.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 Processor -- start 2024-09-13T18:06:11.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 -- start start 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 0x7f19f0158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f00719b0 0x7f19f00c1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19f00c5090 0x7f19f014c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c8530 con 0x7f19f00c5090 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c87d0 con 0x7f19f00719b0 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f647e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c8ab0 con 0x7f19f006c170 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f5c7d700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19f00c5090 msgr2=0x7f19f014c990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f5c7d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19f00c5090 0x7f19f014c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 0x7f19f0158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 0x7f19f0158d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:59658/0 (socket says 172.21.15.88:59658) 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 -- 172.21.15.88:0/3019453018 learned_addr learned my addr 172.21.15.88:0/3019453018 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f00719b0 0x7f19f00c1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f00719b0 msgr2=0x7f19f00c1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f19f00719b0 0x7f19f00c1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19f00c5090 msgr2=0x7f19f014c990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19f00c5090 0x7f19f014c990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.451+0000 7f19f547c700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8009a70 con 0x7f19f006c170 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f547c700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 0x7f19f0158d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19e800c700 tx=0x7f19e800ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8005d90 con 0x7f19f006c170 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00c8d90 con 0x7f19f006c170 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e80070d0 con 0x7f19f006c170 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8007480 con 0x7f19f006c170 2024-09-13T18:06:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00c21f0 con 0x7f19f006c170 2024-09-13T18:06:11.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f647e700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 0x7f19f015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0068400 con 0x7f19f00c4930 2024-09-13T18:06:11.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 0x7f19f015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f19e80075e0 con 0x7f19f006c170 2024-09-13T18:06:11.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f4c7b700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19f015db70 con 0x7f19f00c4930 2024-09-13T18:06:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 0x7f19f015ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f19d00666e0 0x7f19d0068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e8083680 con 0x7f19f006c170 2024-09-13T18:06:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8012c00 con 0x7f19f00c4930 2024-09-13T18:06:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.455+0000 7f19f5c7d700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f19d00666e0 0x7f19d0068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19f5c7d700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f19d00666e0 0x7f19d0068ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19e0003a30 tx=0x7f19e0006d70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f19d8012d60 con 0x7f19f00c4930 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 msgr2=0x7f19f015ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19edffb700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 0x7f19f015ae40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009d90 tx=0x7f19d8004af0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 msgr2=0x7f19f015ae40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.459+0000 7f19edffb700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f00c4930 0x7f19f015ae40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:11.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.467+0000 7f19f647e700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 0x7f19f014a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:11.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.467+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c8c40 con 0x7f19f015b380 2024-09-13T18:06:11.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.467+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 0x7f19f014a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:11.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f4c7b700 1 -- 172.21.15.88:0/3019453018 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f19f015d890 con 0x7f19f015b380 2024-09-13T18:06:11.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f4c7b700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 0x7f19f014a780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b370 tx=0x7f19d8012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:11.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d802b310 con 0x7f19f015b380 2024-09-13T18:06:11.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4770 (secure 0 0 0) 0x7f19d802f070 con 0x7f19f015b380 2024-09-13T18:06:11.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 msgr2=0x7f19f014a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 0x7f19f014a780 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b370 tx=0x7f19d8012000 comp rx=0 tx=0).stop 2024-09-13T18:06:11.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 msgr2=0x7f19f014a780 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:11.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19edffb700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f015b380 0x7f19f014a780 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f19d800b370 tx=0x7f19d8012000 comp rx=0 tx=0).stop 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 10, 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:11.477 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:11.478 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:11.479 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:11.480 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.481 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.482 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:11.483 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:11.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:11.488 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:11.489 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f19d00666e0 msgr2=0x7f19d0068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f19d00666e0 0x7f19d0068ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19e0003a30 tx=0x7f19e0006d70 comp rx=0 tx=0).stop 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 msgr2=0x7f19f0158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 --2- 172.21.15.88:0/3019453018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f19f006c170 0x7f19f0158d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f19e800c700 tx=0x7f19e800ca10 comp rx=0 tx=0).stop 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f5c7d700 1 -- 172.21.15.88:0/3019453018 reap_dead start 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f5c7d700 1 -- 172.21.15.88:0/3019453018 reap_dead start 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 shutdown_connections 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 >> 172.21.15.88:0/3019453018 conn(0x7f19f00664b0 msgr2=0x7f19f0155bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:11.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 shutdown_connections 2024-09-13T18:06:11.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:11.471+0000 7f19f647e700 1 -- 172.21.15.88:0/3019453018 wait complete. 2024-09-13T18:06:11.493 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:06:11.493 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T18:06:31.493 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:06:31.493 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T18:06:31.493 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:06:31.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:06:31.496 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:06:31.496 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:06:31.497 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.615+0000 7f2e79430700 1 Processor -- start 2024-09-13T18:06:31.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.615+0000 7f2e79430700 1 -- start start 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 0x7f2e7406e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 0x7f2e740c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7406eae0 con 0x7f2e7406b900 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7406c690 con 0x7f2e74150c50 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e79430700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7406bdf0 con 0x7f2e740c1670 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e73fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 0x7f2e7406e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:56110/0 (socket says 172.21.15.88:56110) 2024-09-13T18:06:31.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 -- 172.21.15.88:0/327417318 learned_addr learned my addr 172.21.15.88:0/327417318 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 -- 172.21.15.88:0/327417318 >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 msgr2=0x7f2e7406e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 0x7f2e740c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 0x7f2e7406e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 -- 172.21.15.88:0/327417318 >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 msgr2=0x7f2e740c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 0x7f2e740c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 -- 172.21.15.88:0/327417318 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7406c0d0 con 0x7f2e740c1670 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 0x7f2e740c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e73fff700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 0x7f2e7406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e737fe700 1 --2- 172.21.15.88:0/327417318 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e740cb3f0 tx=0x7f2e68009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b8ebdb7625911a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:31.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e72ffd700 1 -- 172.21.15.88:0/327417318 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011830 con 0x7f2e740c1670 2024-09-13T18:06:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e72ffd700 1 -- 172.21.15.88:0/327417318 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68011990 con 0x7f2e740c1670 2024-09-13T18:06:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.619+0000 7f2e72ffd700 1 -- 172.21.15.88:0/327417318 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68011d20 con 0x7f2e740c1670 2024-09-13T18:06:31.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- 172.21.15.88:0/327417318 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 msgr2=0x7f2e740c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- 172.21.15.88:0/327417318 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e740cb3f0 tx=0x7f2e68009bf0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- 172.21.15.88:0/327417318 shutdown_connections 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- 172.21.15.88:0/327417318 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e740c1670 0x7f2e740c5410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.88:3300/0 conn(0x7f2e7406b900 0x7f2e740c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- 172.21.15.88:0/327417318 >> v2:172.21.15.94:3300/0 conn(0x7f2e74150c50 0x7f2e7406e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- 172.21.15.88:0/327417318 >> 172.21.15.88:0/327417318 conn(0x7f2e740ca720 msgr2=0x7f2e740cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- 172.21.15.88:0/327417318 shutdown_connections 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- 172.21.15.88:0/327417318 wait complete. 2024-09-13T18:06:31.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 Processor -- start 2024-09-13T18:06:31.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- start start 2024-09-13T18:06:31.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740c26e0 con 0x7f2e7406b900 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740c6750 con 0x7f2e740c1670 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e79430700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740c2920 con 0x7f2e74150c50 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46058/0 (socket says 172.21.15.88:46058) 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 -- 172.21.15.88:0/3277042269 learned_addr learned my addr 172.21.15.88:0/3277042269 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 msgr2=0x7f2e74157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 msgr2=0x7f2e74157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e737fe700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e737fe700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 msgr2=0x7f2e740c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e737fe700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 msgr2=0x7f2e740c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e737fe700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e737fe700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e78c2f700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 msgr2=0x7f2e740c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e78c2f700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 msgr2=0x7f2e740c33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:31.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.623+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e737fe700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e73fff700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 msgr2=0x7f2e74157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e73fff700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 msgr2=0x7f2e74157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:31.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.832 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 msgr2=0x7f2e740c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 msgr2=0x7f2e74157d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 -- 172.21.15.88:0/3277042269 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e640094b0 con 0x7f2e74150c50 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e78c2f700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e740714b0 tx=0x7f2e6c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c003c40 con 0x7f2e74150c50 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c013070 con 0x7f2e74150c50 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e68009570 con 0x7f2e74150c50 2024-09-13T18:06:31.833 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00eeb0 con 0x7f2e74150c50 2024-09-13T18:06:31.834 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.827+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740c2400 con 0x7f2e74150c50 2024-09-13T18:06:31.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2e6c00b040 con 0x7f2e74150c50 2024-09-13T18:06:31.835 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e70ff9700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 0x7f2e60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740c69c0 con 0x7f2e74150c50 2024-09-13T18:06:31.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 0x7f2e60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:31.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e73fff700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 0x7f2e60068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009760 tx=0x7f2e64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:31.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.831+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2e6c015070 con 0x7f2e74150c50 2024-09-13T18:06:31.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:31.839+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2e6c0515e0 con 0x7f2e74150c50 2024-09-13T18:06:32.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.099+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2e740c21b0 con 0x7f2e74150c50 2024-09-13T18:06:32.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.099+0000 7f2e70ff9700 1 -- 172.21.15.88:0/3277042269 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f2e6c054c00 con 0x7f2e74150c50 2024-09-13T18:06:32.105 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 msgr2=0x7f2e60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 0x7f2e60068bf0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009760 tx=0x7f2e64008040 comp rx=0 tx=0).stop 2024-09-13T18:06:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 msgr2=0x7f2e740c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e740714b0 tx=0x7f2e6c00ecd0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.108 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 shutdown_connections 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2e60066730 0x7f2e60068bf0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e74150c50 0x7f2e740c33d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e740c1670 0x7f2e740c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 --2- 172.21.15.88:0/3277042269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e7406b900 0x7f2e74157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 >> 172.21.15.88:0/3277042269 conn(0x7f2e740ca720 msgr2=0x7f2e74155bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 shutdown_connections 2024-09-13T18:06:32.109 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.103+0000 7f2e79430700 1 -- 172.21.15.88:0/3277042269 wait complete. 2024-09-13T18:06:32.120 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:06:32.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:06:32.121 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:06:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 Processor -- start 2024-09-13T18:06:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 -- start start 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febd4151110 0x7febd40c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40adfa0 con 0x7febd40c6f10 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd40adcc0 con 0x7febd40c5c50 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febdc3a2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd4156ff0 con 0x7febd4151110 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febda13e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febd4151110 0x7febd40c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febd993d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7febd40c6f10 0x7febd40717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55760/0 (socket says 172.21.15.88:55760) 2024-09-13T18:06:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.219+0000 7febd993d700 1 -- 172.21.15.88:0/2946296720 learned_addr learned my addr 172.21.15.88:0/2946296720 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febda13e700 1 -- 172.21.15.88:0/2946296720 >> v1:172.21.15.94:6789/0 conn(0x7febd40c5c50 legacy=0x7febd41617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febd913c700 1 -- 172.21.15.88:0/2946296720 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790628334 0 0) 0x7febd40adfa0 con 0x7febd40c6f10 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febda13e700 1 -- 172.21.15.88:0/2946296720 >> v1:172.21.15.88:6789/0 conn(0x7febd40c6f10 legacy=0x7febd40717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febda13e700 1 -- 172.21.15.88:0/2946296720 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd41572d0 con 0x7febd4151110 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febda13e700 1 --2- 172.21.15.88:0/2946296720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c69d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7febc4009850 tx=0x7febc4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b0b2775e6826d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febd913c700 1 -- 172.21.15.88:0/2946296720 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4004230 con 0x7febd4151110 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febd913c700 1 -- 172.21.15.88:0/2946296720 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc4004390 con 0x7febd4151110 2024-09-13T18:06:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febd913c700 1 -- 172.21.15.88:0/2946296720 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc40036c0 con 0x7febd4151110 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- 172.21.15.88:0/2946296720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 msgr2=0x7febd40c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 --2- 172.21.15.88:0/2946296720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c69d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7febc4009850 tx=0x7febc4009b60 comp rx=0 tx=0).stop 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- 172.21.15.88:0/2946296720 shutdown_connections 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 --2- 172.21.15.88:0/2946296720 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c69d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- 172.21.15.88:0/2946296720 >> 172.21.15.88:0/2946296720 conn(0x7febd40cb430 msgr2=0x7febd40cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- 172.21.15.88:0/2946296720 shutdown_connections 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- 172.21.15.88:0/2946296720 wait complete. 2024-09-13T18:06:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 Processor -- start 2024-09-13T18:06:32.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.223+0000 7febdc3a2700 1 -- start start 2024-09-13T18:06:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd40c5c50 0x7febd40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7febd40c6f10 0x7febd40c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd40b1430 con 0x7febd4151110 2024-09-13T18:06:32.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd406c550 con 0x7febd40c5c50 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd40af970 con 0x7febd40c6f10 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46068/0 (socket says 172.21.15.88:46068) 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 -- 172.21.15.88:0/1590705675 learned_addr learned my addr 172.21.15.88:0/1590705675 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda13e700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd40c5c50 0x7febd40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febd993d700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7febd40c6f10 0x7febd40c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7febd40c6f10 msgr2=0x7febd40c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7febd40c6f10 0x7febd40c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd40c5c50 msgr2=0x7febd40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7febd40c5c50 0x7febd40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40094b0 con 0x7febd4151110 2024-09-13T18:06:32.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda93f700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febcc00cc10 tx=0x7febcc00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc00aa60 con 0x7febd4151110 2024-09-13T18:06:32.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febcc00abc0 con 0x7febd4151110 2024-09-13T18:06:32.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febcc012420 con 0x7febd4151110 2024-09-13T18:06:32.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd40b0e70 con 0x7febd4151110 2024-09-13T18:06:32.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd40af0d0 con 0x7febd4151110 2024-09-13T18:06:32.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 0x7febd41f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4067ae0 con 0x7febd40af2f0 2024-09-13T18:06:32.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febda13e700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 0x7febd41f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.227+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7febcc012580 con 0x7febd4151110 2024-09-13T18:06:32.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febda13e700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febd4157db0 con 0x7febd40af2f0 2024-09-13T18:06:32.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febda13e700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 0x7febd41f2200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc4009fd0 tx=0x7febc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7febb8066760 0x7febb8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7febcc084330 con 0x7febd4151110 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4006ea0 con 0x7febd40af2f0 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febd993d700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7febb8066760 0x7febb8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7febc4025440 con 0x7febd40af2f0 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 msgr2=0x7febd41f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 0x7febd41f2200 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7febc4009fd0 tx=0x7febc4004770 comp rx=0 tx=0).stop 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 msgr2=0x7febd41f2200 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febcaffd700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd40af2f0 0x7febd41f2200 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.231+0000 7febd993d700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7febb8066760 0x7febb8068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febd40cba80 tx=0x7febd0007e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 0x7febd414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd4157890 con 0x7febd4071760 2024-09-13T18:06:32.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febda13e700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 0x7febd414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febda13e700 1 -- 172.21.15.88:0/1590705675 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7febd41514f0 con 0x7febd4071760 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febda13e700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 0x7febd414cfd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febd4063e40 tx=0x7febc4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc4025a70 con 0x7febd4071760 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4451 (secure 0 0 0) 0x7febc402f070 con 0x7febd4071760 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 msgr2=0x7febd414cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 0x7febd414cfd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febd4063e40 tx=0x7febc4011000 comp rx=0 tx=0).stop 2024-09-13T18:06:32.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 msgr2=0x7febd414cfd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febcaffd700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4071760 0x7febd414cfd0 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7febd4063e40 tx=0x7febc4011000 comp rx=0 tx=0).stop 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.246 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.247 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:32.248 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.249 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.250 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.251 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.252 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.253 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:32.254 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:32.255 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.256 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.257 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:32.257 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7febb8066760 msgr2=0x7febb8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7febb8066760 0x7febb8068c20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7febd40cba80 tx=0x7febd0007e00 comp rx=0 tx=0).stop 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 msgr2=0x7febd40c0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7febcc00cc10 tx=0x7febcc00cf20 comp rx=0 tx=0).stop 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febda93f700 1 -- 172.21.15.88:0/1590705675 reap_dead start 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 shutdown_connections 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 --2- 172.21.15.88:0/1590705675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd4151110 0x7febd40c0b90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 >> 172.21.15.88:0/1590705675 conn(0x7febd40cb430 msgr2=0x7febd40c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 shutdown_connections 2024-09-13T18:06:32.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.239+0000 7febdc3a2700 1 -- 172.21.15.88:0/1590705675 wait complete. 2024-09-13T18:06:32.259 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:32.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:06:32.259 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:06:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 Processor -- start 2024-09-13T18:06:32.363 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- start start 2024-09-13T18:06:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c007c70 0x7f593c045e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f593c045480 0x7f593c0e5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0334f0 con 0x7f593c045a40 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c033a00 con 0x7f593c045480 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c046360 con 0x7f593c007c70 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f593c045480 0x7f593c0e5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f593c045480 0x7f593c0e5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46096/0 (socket says 172.21.15.88:46096) 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 -- 172.21.15.88:0/3247108027 learned_addr learned my addr 172.21.15.88:0/3247108027 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59427fc700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c007c70 0x7f593c045e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 -- 172.21.15.88:0/3247108027 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c007c70 msgr2=0x7f593c045e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c007c70 0x7f593c045e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 -- 172.21.15.88:0/3247108027 >> v1:172.21.15.94:6789/0 conn(0x7f593c045a40 legacy=0x7f593c0df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 -- 172.21.15.88:0/3247108027 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c033720 con 0x7f593c045480 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f59437fe700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c045480 0x7f593c0e5d20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5944068e70 tx=0x7f594404f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db3cf6cd92085b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5941ffb700 1 -- 172.21.15.88:0/3247108027 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59440675d0 con 0x7f593c045480 2024-09-13T18:06:32.365 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5941ffb700 1 -- 172.21.15.88:0/3247108027 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944067730 con 0x7f593c045480 2024-09-13T18:06:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5941ffb700 1 -- 172.21.15.88:0/3247108027 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944068420 con 0x7f593c045480 2024-09-13T18:06:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- 172.21.15.88:0/3247108027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c045480 msgr2=0x7f593c0e5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.366 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c045480 0x7f593c0e5d20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5944068e70 tx=0x7f594404f710 comp rx=0 tx=0).stop 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- 172.21.15.88:0/3247108027 shutdown_connections 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c045480 0x7f593c0e5d20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 --2- 172.21.15.88:0/3247108027 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c007c70 0x7f593c045e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- 172.21.15.88:0/3247108027 >> 172.21.15.88:0/3247108027 conn(0x7f593c0505e0 msgr2=0x7f593c0509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- 172.21.15.88:0/3247108027 shutdown_connections 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.359+0000 7f5943fff700 1 -- 172.21.15.88:0/3247108027 wait complete. 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 Processor -- start 2024-09-13T18:06:32.367 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- start start 2024-09-13T18:06:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c045480 0x7f593c0cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c045a40 0x7f593c1734a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1754c0 con 0x7f593c007c70 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c172af0 con 0x7f593c045480 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c172d90 con 0x7f593c045a40 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46098/0 (socket says 172.21.15.88:46098) 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 -- 172.21.15.88:0/846750060 learned_addr learned my addr 172.21.15.88:0/846750060 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f59427fc700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c045480 0x7f593c0cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f59437fe700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c045a40 0x7f593c1734a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c045a40 msgr2=0x7f593c1734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f593c045a40 0x7f593c1734a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.370 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c045480 msgr2=0x7f593c0cfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c045480 0x7f593c0cfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c1756b0 con 0x7f593c007c70 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5942ffd700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f593400c4f0 tx=0x7f593400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59340052d0 con 0x7f593c007c70 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5934005430 con 0x7f593c007c70 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c175970 con 0x7f593c007c70 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5934003930 con 0x7f593c007c70 2024-09-13T18:06:32.371 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.363+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c04f320 con 0x7f593c007c70 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f5943fff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 0x7f593c006da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c008d50 con 0x7f593c006990 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f59427fc700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 0x7f593c006da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f59427fc700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f593c0de990 con 0x7f593c006990 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f59427fc700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 0x7f593c006da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f593c007780 tx=0x7f5938011c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5934003a90 con 0x7f593c007c70 2024-09-13T18:06:32.372 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f593006aae0 0x7f593006cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f59340836d0 con 0x7f593c007c70 2024-09-13T18:06:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938004240 con 0x7f593c006990 2024-09-13T18:06:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f59437fe700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f593006aae0 0x7f593006cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f59380043a0 con 0x7f593c006990 2024-09-13T18:06:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 msgr2=0x7f593c006da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 0x7f593c006da0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f593c007780 tx=0x7f5938011c80 comp rx=0 tx=0).stop 2024-09-13T18:06:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 msgr2=0x7f593c006da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f592bfff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c006990 0x7f593c006da0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.374 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.367+0000 7f59437fe700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f593006aae0 0x7f593006cfa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f593c047660 tx=0x7f594408d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.382 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 0x7f593c0db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.383 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c175b00 con 0x7f593c0072e0 2024-09-13T18:06:32.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f59427fc700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 0x7f593c0db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f59427fc700 1 -- 172.21.15.88:0/846750060 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f593c0062a0 con 0x7f593c0072e0 2024-09-13T18:06:32.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f59427fc700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 0x7f593c0db3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f593801b000 tx=0x7f5938004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.384 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593801e450 con 0x7f593c0072e0 2024-09-13T18:06:32.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4947 (secure 0 0 0) 0x7f59380283a0 con 0x7f593c0072e0 2024-09-13T18:06:32.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 msgr2=0x7f593c0db3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 0x7f593c0db3c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f593801b000 tx=0x7f5938004770 comp rx=0 tx=0).stop 2024-09-13T18:06:32.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 msgr2=0x7f593c0db3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f592bfff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f593c0072e0 0x7f593c0db3c0 secure :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f593801b000 tx=0x7f5938004770 comp rx=0 tx=0).stop 2024-09-13T18:06:32.387 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:32.387 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:32.387 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:32.387 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:06:32.387 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.388 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.389 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.390 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:32.391 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.392 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:32.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.394 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.395 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.396 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.397 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.398 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.399 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:32.400 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.401 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.402 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.403 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:32.404 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f593006aae0 msgr2=0x7f593006cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f593006aae0 0x7f593006cfa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f593c047660 tx=0x7f594408d000 comp rx=0 tx=0).stop 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 msgr2=0x7f593c176170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f59437fe700 1 -- 172.21.15.88:0/846750060 reap_dead start 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f593400c4f0 tx=0x7f593400c800 comp rx=0 tx=0).stop 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 shutdown_connections 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 --2- 172.21.15.88:0/846750060 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f593c007c70 0x7f593c176170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.405 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 >> 172.21.15.88:0/846750060 conn(0x7f593c0505e0 msgr2=0x7f593c0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 shutdown_connections 2024-09-13T18:06:32.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.379+0000 7f5943fff700 1 -- 172.21.15.88:0/846750060 wait complete. 2024-09-13T18:06:32.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:32.406 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:06:32.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:06:32.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 Processor -- start 2024-09-13T18:06:32.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 -- start start 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9ec0c1680 0x7fe9ec162470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0b13d0 con 0x7fe9ec0c5260 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0bfff0 con 0x7fe9ec1542f0 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f315f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec1546d0 con 0x7fe9ec0c1680 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f195c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe9ec0c5260 0x7fe9ec0c0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55772/0 (socket says 172.21.15.88:55772) 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f195c700 1 -- 172.21.15.88:0/3664443283 learned_addr learned my addr 172.21.15.88:0/3664443283 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f295e700 1 --2- 172.21.15.88:0/3664443283 >> v2:172.21.15.88:3300/0 conn(0x7fe9ec0c1680 0x7fe9ec162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f115b700 1 -- 172.21.15.88:0/3664443283 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615512501 0 0) 0x7fe9ec0b13d0 con 0x7fe9ec0c5260 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f115b700 1 -- 172.21.15.88:0/3664443283 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d40035d0 con 0x7fe9ec0c5260 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f295e700 1 -- 172.21.15.88:0/3664443283 >> v1:172.21.15.94:6789/0 conn(0x7fe9ec1542f0 legacy=0x7fe9ec06e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f295e700 1 -- 172.21.15.88:0/3664443283 >> v1:172.21.15.88:6789/0 conn(0x7fe9ec0c5260 legacy=0x7fe9ec0c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f295e700 1 -- 172.21.15.88:0/3664443283 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0c0800 con 0x7fe9ec0c1680 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f295e700 1 --2- 172.21.15.88:0/3664443283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec0c1680 0x7fe9ec162470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80490dff7749d7d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f115b700 1 -- 172.21.15.88:0/3664443283 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011830 con 0x7fe9ec0c1680 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f115b700 1 -- 172.21.15.88:0/3664443283 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e4011990 con 0x7fe9ec0c1680 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.511+0000 7fe9f115b700 1 -- 172.21.15.88:0/3664443283 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4011d40 con 0x7fe9ec0c1680 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- 172.21.15.88:0/3664443283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec0c1680 msgr2=0x7fe9ec162470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 --2- 172.21.15.88:0/3664443283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec0c1680 0x7fe9ec162470 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009850 tx=0x7fe9e4009b60 comp rx=0 tx=0).stop 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- 172.21.15.88:0/3664443283 shutdown_connections 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 --2- 172.21.15.88:0/3664443283 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec0c1680 0x7fe9ec162470 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- 172.21.15.88:0/3664443283 >> 172.21.15.88:0/3664443283 conn(0x7fe9ec0cb600 msgr2=0x7fe9ec0c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- 172.21.15.88:0/3664443283 shutdown_connections 2024-09-13T18:06:32.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- 172.21.15.88:0/3664443283 wait complete. 2024-09-13T18:06:32.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 Processor -- start 2024-09-13T18:06:32.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- start start 2024-09-13T18:06:32.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c1680 0x7fe9ec1dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9ec0c5260 0x7fe9ec0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1ed390 con 0x7fe9ec1542f0 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1e3fd0 con 0x7fe9ec0c5260 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f315f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1ec730 con 0x7fe9ec0c1680 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f295e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f295e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46124/0 (socket says 172.21.15.88:46124) 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f295e700 1 -- 172.21.15.88:0/488344388 learned_addr learned my addr 172.21.15.88:0/488344388 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f215d700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c1680 0x7fe9ec1dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.515+0000 7fe9f195c700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9ec0c5260 0x7fe9ec0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c1680 msgr2=0x7fe9ec1dcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c1680 0x7fe9ec1dcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9ec0c5260 msgr2=0x7fe9ec0c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9ec0c5260 0x7fe9ec0c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e40094b0 con 0x7fe9ec1542f0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f295e700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4014040 tx=0x7fe9e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4019980 con 0x7fe9ec1542f0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e401e070 con 0x7fe9ec1542f0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec0c2570 con 0x7fe9ec1542f0 2024-09-13T18:06:32.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4019d20 con 0x7fe9ec1542f0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec1eccd0 con 0x7fe9ec1542f0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f315f700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 0x7fe9ec0c36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec068400 con 0x7fe9ec0c7620 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f215d700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 0x7fe9ec0c36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f215d700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe9ec0c0240 con 0x7fe9ec0c7620 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe9e401a420 con 0x7fe9ec1542f0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f215d700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 0x7fe9ec0c36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00ffd0 tx=0x7fe9dc00d430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe9d806ab40 0x7fe9d806d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe9e4085120 con 0x7fe9ec1542f0 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc003c30 con 0x7fe9ec0c7620 2024-09-13T18:06:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9f195c700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe9d806ab40 0x7fe9d806d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.519+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe9dc003d90 con 0x7fe9ec0c7620 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.523+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 msgr2=0x7fe9ec0c36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.523+0000 7fe9eaffd700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 0x7fe9ec0c36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00ffd0 tx=0x7fe9dc00d430 comp rx=0 tx=0).stop 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.523+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 msgr2=0x7fe9ec0c36b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.523+0000 7fe9eaffd700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c7620 0x7fe9ec0c36b0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00ffd0 tx=0x7fe9dc00d430 comp rx=0 tx=0).stop 2024-09-13T18:06:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.523+0000 7fe9f195c700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe9d806ab40 0x7fe9d806d000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06eaa0 tx=0x7fe9e0007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9f315f700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 0x7fe9ec1de8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec1454d0 con 0x7fe9ec0c4560 2024-09-13T18:06:32.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9f215d700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 0x7fe9ec1de8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.539 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9f215d700 1 -- 172.21.15.88:0/488344388 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe9ec0c1dd0 con 0x7fe9ec0c4560 2024-09-13T18:06:32.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9f215d700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 0x7fe9ec1de8d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc017000 tx=0x7fe9dc0014a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc023070 con 0x7fe9ec0c4560 2024-09-13T18:06:32.541 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7fe9dc01ee70 con 0x7fe9ec0c4560 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 msgr2=0x7fe9ec1de8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 0x7fe9ec1de8d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc017000 tx=0x7fe9dc0014a0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 msgr2=0x7fe9ec1de8d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.535+0000 7fe9eaffd700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9ec0c4560 0x7fe9ec1de8d0 secure :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc017000 tx=0x7fe9dc0014a0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:32.542 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.543 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.544 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:32.545 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:32.546 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.547 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:32.548 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:32.549 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.550 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:32.551 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.552 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:32.553 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.554 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.555 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:32.556 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:32.557 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:32.557 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe9d806ab40 msgr2=0x7fe9d806d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe9d806ab40 0x7fe9d806d000 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec06eaa0 tx=0x7fe9e0007de0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 msgr2=0x7fe9ec0c3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4014040 tx=0x7fe9e4004770 comp rx=0 tx=0).stop 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f295e700 1 -- 172.21.15.88:0/488344388 reap_dead start 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 shutdown_connections 2024-09-13T18:06:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 --2- 172.21.15.88:0/488344388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9ec1542f0 0x7fe9ec0c3170 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 >> 172.21.15.88:0/488344388 conn(0x7fe9ec0cb600 msgr2=0x7fe9ec0c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 shutdown_connections 2024-09-13T18:06:32.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.539+0000 7fe9f315f700 1 -- 172.21.15.88:0/488344388 wait complete. 2024-09-13T18:06:32.559 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:32.559 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T18:06:32.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T18:06:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 Processor -- start 2024-09-13T18:06:32.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- start start 2024-09-13T18:06:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f491c156cd0 0x7f491c1618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c066850 con 0x7f491c150190 2024-09-13T18:06:32.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f491c0c5e80 con 0x7f491c150570 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f491c06d900 con 0x7f491c156cd0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f491c156cd0 0x7f491c1618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f491c156cd0 0x7f491c1618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46132/0 (socket says 172.21.15.88:46132) 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 -- 172.21.15.88:0/201147793 learned_addr learned my addr 172.21.15.88:0/201147793 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 -- 172.21.15.88:0/201147793 >> v1:172.21.15.94:6789/0 conn(0x7f491c150570 legacy=0x7f491c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 -- 172.21.15.88:0/201147793 >> v1:172.21.15.88:6789/0 conn(0x7f491c150190 legacy=0x7f491c06feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 -- 172.21.15.88:0/201147793 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c06d620 con 0x7f491c156cd0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f4920f6b700 1 --2- 172.21.15.88:0/201147793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c156cd0 0x7f491c1618e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f491400d150 tx=0x7f491400d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91dfe8bdbf10a23 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f491b7fe700 1 -- 172.21.15.88:0/201147793 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4914010070 con 0x7f491c156cd0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f491b7fe700 1 -- 172.21.15.88:0/201147793 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491400dd80 con 0x7f491c156cd0 2024-09-13T18:06:32.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f491b7fe700 1 -- 172.21.15.88:0/201147793 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491400b310 con 0x7f491c156cd0 2024-09-13T18:06:32.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- 172.21.15.88:0/201147793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c156cd0 msgr2=0x7f491c1618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 --2- 172.21.15.88:0/201147793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c156cd0 0x7f491c1618e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f491400d150 tx=0x7f491400d460 comp rx=0 tx=0).stop 2024-09-13T18:06:32.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- 172.21.15.88:0/201147793 shutdown_connections 2024-09-13T18:06:32.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 --2- 172.21.15.88:0/201147793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c156cd0 0x7f491c1618e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- 172.21.15.88:0/201147793 >> 172.21.15.88:0/201147793 conn(0x7f491c0c7de0 msgr2=0x7f491c0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- 172.21.15.88:0/201147793 shutdown_connections 2024-09-13T18:06:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.659+0000 7f49229ce700 1 -- 172.21.15.88:0/201147793 wait complete. 2024-09-13T18:06:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 Processor -- start 2024-09-13T18:06:32.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- start start 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 0x7f491c1ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 0x7f491c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1eff20 con 0x7f491c150570 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1e43b0 con 0x7f491c156cd0 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f491c1df410 con 0x7f491c150190 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46146/0 (socket says 172.21.15.88:46146) 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 -- 172.21.15.88:0/248497498 learned_addr learned my addr 172.21.15.88:0/248497498 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f491bfff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 0x7f491c1ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4920f6b700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 0x7f491c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 -- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 msgr2=0x7f491c1ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 0x7f491c1ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 -- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 msgr2=0x7f491c14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 0x7f491c14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 -- 172.21.15.88:0/248497498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491400bd40 con 0x7f491c150570 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4920f6b700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 0x7f491c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f491bfff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 0x7f491c1ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f4913fff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c550 tx=0x7f490c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011790 con 0x7f491c150570 2024-09-13T18:06:32.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490c0118f0 con 0x7f491c150570 2024-09-13T18:06:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f491c1e1080 con 0x7f491c150570 2024-09-13T18:06:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490c011ca0 con 0x7f491c150570 2024-09-13T18:06:32.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.663+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f491c1df6b0 con 0x7f491c150570 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f491c071240 con 0x7f491c150570 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f490c01c460 con 0x7f491c150570 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f49197fa700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f490c083f90 con 0x7f491c150570 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f491bfff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:32.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.667+0000 7f491bfff700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 0x7f48fc068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f49040017a0 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:32.678 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.671+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f490c0b5db0 con 0x7f491c150570 2024-09-13T18:06:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.895+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f491c072930 con 0x7f491c150570 2024-09-13T18:06:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.895+0000 7f49197fa700 1 -- 172.21.15.88:0/248497498 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f490c051280 con 0x7f491c150570 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 msgr2=0x7f48fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 0x7f48fc068c20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f49040017a0 tx=0x7f4904009040 comp rx=0 tx=0).stop 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 msgr2=0x7f491c1e0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f490c00c550 tx=0x7f490c00c910 comp rx=0 tx=0).stop 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 shutdown_connections 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f48fc066760 0x7f48fc068c20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f491c156cd0 0x7f491c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f491c150570 0x7f491c1e0b40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 --2- 172.21.15.88:0/248497498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f491c150190 0x7f491c1ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 >> 172.21.15.88:0/248497498 conn(0x7f491c0c7de0 msgr2=0x7f491c1565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 shutdown_connections 2024-09-13T18:06:32.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:32.899+0000 7f49229ce700 1 -- 172.21.15.88:0/248497498 wait complete. 2024-09-13T18:06:32.915 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-13T18:06:33.694 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:06:33.696 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:06:42.916 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:06:42.916 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.035+0000 7fd919f0b700 1 Processor -- start 2024-09-13T18:06:43.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.035+0000 7fd919f0b700 1 -- start start 2024-09-13T18:06:43.043 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd9140c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9140c8e50 0x7fd9140c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd914155f20 con 0x7fd914159720 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140c7f00 con 0x7fd9140c8e50 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd914156200 con 0x7fd9140c8a70 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9140c8e50 0x7fd9140c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9140c8e50 0x7fd9140c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46304/0 (socket says 172.21.15.88:46304) 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 -- 172.21.15.88:0/3240499207 learned_addr learned my addr 172.21.15.88:0/3240499207 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd918f09700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd9140c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 -- 172.21.15.88:0/3240499207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 msgr2=0x7fd9140c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd9140c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 -- 172.21.15.88:0/3240499207 >> v1:172.21.15.94:6789/0 conn(0x7fd914159720 legacy=0x7fd914159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 -- 172.21.15.88:0/3240499207 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9141564e0 con 0x7fd9140c8e50 2024-09-13T18:06:43.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd913fff700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd9140c9e90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd900009910 tx=0x7fd900009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9d3708f69cdbdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd9137fe700 1 -- 172.21.15.88:0/3240499207 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900004230 con 0x7fd9140c8e50 2024-09-13T18:06:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd9137fe700 1 -- 172.21.15.88:0/3240499207 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd900004390 con 0x7fd9140c8e50 2024-09-13T18:06:43.045 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd9137fe700 1 -- 172.21.15.88:0/3240499207 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd900009e60 con 0x7fd9140c8e50 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- 172.21.15.88:0/3240499207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 msgr2=0x7fd9140c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd9140c9e90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd900009910 tx=0x7fd900009c20 comp rx=0 tx=0).stop 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- 172.21.15.88:0/3240499207 shutdown_connections 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd9140c9e90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 --2- 172.21.15.88:0/3240499207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd9140c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- 172.21.15.88:0/3240499207 >> 172.21.15.88:0/3240499207 conn(0x7fd91406a820 msgr2=0x7fd91406ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- 172.21.15.88:0/3240499207 shutdown_connections 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- 172.21.15.88:0/3240499207 wait complete. 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 Processor -- start 2024-09-13T18:06:43.046 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.039+0000 7fd919f0b700 1 -- start start 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd914158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 0x7fd9141f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140c53b0 con 0x7fd9140c8e50 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9141ef970 con 0x7fd914159720 2024-09-13T18:06:43.048 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd919f0b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd914158970 con 0x7fd9140c8a70 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd91970a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 0x7fd9141f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:37246/0 (socket says 172.21.15.88:37246) 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 -- 172.21.15.88:0/849389460 learned_addr learned my addr 172.21.15.88:0/849389460 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 -- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 msgr2=0x7fd9141f2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 0x7fd9141f2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 -- 172.21.15.88:0/849389460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 msgr2=0x7fd914158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd914158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 -- 172.21.15.88:0/849389460 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd900009570 con 0x7fd9140c8a70 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd91970a700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 0x7fd9141f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:43.049 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.043+0000 7fd918f09700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd90800e810 tx=0x7fd90800eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908013610 con 0x7fd9140c8a70 2024-09-13T18:06:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908013790 con 0x7fd9140c8a70 2024-09-13T18:06:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908013b40 con 0x7fd9140c8a70 2024-09-13T18:06:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9141624c0 con 0x7fd9140c8a70 2024-09-13T18:06:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9141621e0 con 0x7fd9140c8a70 2024-09-13T18:06:43.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9140c3900 con 0x7fd9140c8a70 2024-09-13T18:06:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.047+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd908013ca0 con 0x7fd9140c8a70 2024-09-13T18:06:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.051+0000 7fd9117fa700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 0x7fd8f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.051+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd908084340 con 0x7fd9140c8a70 2024-09-13T18:06:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.051+0000 7fd913fff700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 0x7fd8f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.055 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.051+0000 7fd913fff700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 0x7fd8f8068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd900009910 tx=0x7fd900010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.055+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd908051630 con 0x7fd9140c8a70 2024-09-13T18:06:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.367+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd9140c6230 con 0x7fd9140c8a70 2024-09-13T18:06:43.373 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.367+0000 7fd9117fa700 1 -- 172.21.15.88:0/849389460 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fd908021620 con 0x7fd9140c8a70 2024-09-13T18:06:43.373 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 msgr2=0x7fd8f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 0x7fd8f8068bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd900009910 tx=0x7fd900010000 comp rx=0 tx=0).stop 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 msgr2=0x7fd91414d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd90800e810 tx=0x7fd90800eb20 comp rx=0 tx=0).stop 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 shutdown_connections 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd8f8066730 0x7fd8f8068bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd914159720 0x7fd9141f2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9140c8e50 0x7fd914158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.376 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 --2- 172.21.15.88:0/849389460 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140c8a70 0x7fd91414d3b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 >> 172.21.15.88:0/849389460 conn(0x7fd91406a820 msgr2=0x7fd91406ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 shutdown_connections 2024-09-13T18:06:43.377 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.371+0000 7fd919f0b700 1 -- 172.21.15.88:0/849389460 wait complete. 2024-09-13T18:06:43.385 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:06:43.386 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T18:06:43.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:06:43.386 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:06:43.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 Processor -- start 2024-09-13T18:06:43.501 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 -- start start 2024-09-13T18:06:43.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f30b00c65f0 0x7f30b006e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b00c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.502 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30b0157d30 con 0x7f30b01510a0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30b006d0e0 con 0x7f30b00c65f0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b6300700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b006eea0 con 0x7f30b00c4e40 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f30b00c65f0 0x7f30b006e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f30b00c65f0 0x7f30b006e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46312/0 (socket says 172.21.15.88:46312) 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 -- 172.21.15.88:0/2484536759 learned_addr learned my addr 172.21.15.88:0/2484536759 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b5aff700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b00c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 -- 172.21.15.88:0/2484536759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 msgr2=0x7f30b00c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b00c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 -- 172.21.15.88:0/2484536759 >> v1:172.21.15.88:6789/0 conn(0x7f30b01510a0 legacy=0x7f30b0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30a7fff700 1 -- 172.21.15.88:0/2484536759 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948942914 0 0) 0x7f30b0157d30 con 0x7f30b01510a0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 -- 172.21.15.88:0/2484536759 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b00c90f0 con 0x7f30b00c65f0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.495+0000 7f30b4afd700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b006e3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009910 tx=0x7f30ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d576754d52615f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.503 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30a7fff700 1 -- 172.21.15.88:0/2484536759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac00ba60 con 0x7f30b00c65f0 2024-09-13T18:06:43.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30a7fff700 1 -- 172.21.15.88:0/2484536759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac00bbc0 con 0x7f30b00c65f0 2024-09-13T18:06:43.504 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30a7fff700 1 -- 172.21.15.88:0/2484536759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac009e60 con 0x7f30b00c65f0 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- 172.21.15.88:0/2484536759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 msgr2=0x7f30b006e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b006e3d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009910 tx=0x7f30ac009c20 comp rx=0 tx=0).stop 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- 172.21.15.88:0/2484536759 shutdown_connections 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b00c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- 172.21.15.88:0/2484536759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b006e3d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- 172.21.15.88:0/2484536759 >> 172.21.15.88:0/2484536759 conn(0x7f30b00666c0 msgr2=0x7f30b006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- 172.21.15.88:0/2484536759 shutdown_connections 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- 172.21.15.88:0/2484536759 wait complete. 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 Processor -- start 2024-09-13T18:06:43.505 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- start start 2024-09-13T18:06:43.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b0149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.507 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30b01510a0 0x7f30b0148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b014b030 con 0x7f30b00c65f0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b014a4b0 con 0x7f30b01510a0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b6300700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30b01ecd20 con 0x7f30b00c4e40 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b4afd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b4afd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46314/0 (socket says 172.21.15.88:46314) 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.499+0000 7f30b4afd700 1 -- 172.21.15.88:0/48925386 learned_addr learned my addr 172.21.15.88:0/48925386 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b0149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b5aff700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30b01510a0 0x7f30b0148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 msgr2=0x7f30b0149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b0149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30b01510a0 msgr2=0x7f30b0148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f30b01510a0 0x7f30b0148270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac009570 con 0x7f30b00c65f0 2024-09-13T18:06:43.508 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f30b00c4e40 0x7f30b0149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:06:43.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b4afd700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30b00c5990 tx=0x7f30ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac004510 con 0x7f30b00c65f0 2024-09-13T18:06:43.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ac01f070 con 0x7f30b00c65f0 2024-09-13T18:06:43.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b0156480 con 0x7f30b00c65f0 2024-09-13T18:06:43.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30b00c23d0 con 0x7f30b00c65f0 2024-09-13T18:06:43.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0038e0 con 0x7f30b00c65f0 2024-09-13T18:06:43.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b6300700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 0x7f30b0146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b0068400 con 0x7f30b00c2560 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 0x7f30b0146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b52fe700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f30b006f390 con 0x7f30b00c2560 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f30ac003a40 con 0x7f30b00c65f0 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 0x7f30b0146140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000f60 tx=0x7f30a000da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3094066730 0x7f3094068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f30ac021070 con 0x7f30b00c65f0 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a000b070 con 0x7f30b00c2560 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f30a00054e0 con 0x7f30b00c2560 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 msgr2=0x7f30b0146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 0x7f30b0146140 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000f60 tx=0x7f30a000da80 comp rx=0 tx=0).stop 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 msgr2=0x7f30b0146140 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30b5aff700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3094066730 0x7f3094068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.511 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.503+0000 7f30a5ffb700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c2560 0x7f30b0146140 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.507+0000 7f30b5aff700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3094066730 0x7f3094068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009f80 tx=0x7f30a800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.519 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 0x7f30b0146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30b006f0b0 con 0x7f30b014e810 2024-09-13T18:06:43.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 0x7f30b0146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b52fe700 1 -- 172.21.15.88:0/48925386 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f30b0157100 con 0x7f30b014e810 2024-09-13T18:06:43.520 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b52fe700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 0x7f30b0146680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000f60 tx=0x7f30a0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30a0020070 con 0x7f30b014e810 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4452 (secure 0 0 0) 0x7f30a0003c60 con 0x7f30b014e810 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 msgr2=0x7f30b0146680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 0x7f30b0146680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000f60 tx=0x7f30a0001080 comp rx=0 tx=0).stop 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 msgr2=0x7f30b0146680 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30a5ffb700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b014e810 0x7f30b0146680 secure :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000f60 tx=0x7f30a0001080 comp rx=0 tx=0).stop 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:43.521 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:43.522 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.523 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:43.524 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:43.525 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.526 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.527 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:43.528 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.529 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.530 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.531 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.532 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:43.533 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3094066730 msgr2=0x7f3094068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3094066730 0x7f3094068bf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009f80 tx=0x7f30a800b040 comp rx=0 tx=0).stop 2024-09-13T18:06:43.534 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 msgr2=0x7f30b0153840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30b00c5990 tx=0x7f30ac004770 comp rx=0 tx=0).stop 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b5aff700 1 -- 172.21.15.88:0/48925386 reap_dead start 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 shutdown_connections 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 --2- 172.21.15.88:0/48925386 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30b00c65f0 0x7f30b0153840 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f30b00c5990 tx=0x7f30ac004770 comp rx=0 tx=0).stop 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 >> 172.21.15.88:0/48925386 conn(0x7f30b00666c0 msgr2=0x7f30b00c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 shutdown_connections 2024-09-13T18:06:43.535 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.515+0000 7f30b6300700 1 -- 172.21.15.88:0/48925386 wait complete. 2024-09-13T18:06:43.535 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:43.535 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:06:43.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:06:43.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 Processor -- start 2024-09-13T18:06:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- start start 2024-09-13T18:06:43.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f29dc0c7360 0x7f29dc155b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc156130 con 0x7f29dc0c14d0 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc156410 con 0x7f29dc0c7740 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc1566f0 con 0x7f29dc0c7360 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e1eb6700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f29dc0c14d0 0x7f29dc14f8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35622/0 (socket says 172.21.15.88:35622) 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e1eb6700 1 -- 172.21.15.88:0/829443003 learned_addr learned my addr 172.21.15.88:0/829443003 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e16b5700 1 --2- 172.21.15.88:0/829443003 >> v2:172.21.15.88:3300/0 conn(0x7f29dc0c7360 0x7f29dc155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29d3fff700 1 -- 172.21.15.88:0/829443003 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244717011 0 0) 0x7f29dc156130 con 0x7f29dc0c14d0 2024-09-13T18:06:43.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29d3fff700 1 -- 172.21.15.88:0/829443003 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c80035d0 con 0x7f29dc0c14d0 2024-09-13T18:06:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e16b5700 1 -- 172.21.15.88:0/829443003 >> v1:172.21.15.94:6789/0 conn(0x7f29dc0c7740 legacy=0x7f29dc0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e16b5700 1 -- 172.21.15.88:0/829443003 >> v1:172.21.15.88:6789/0 conn(0x7f29dc0c14d0 legacy=0x7f29dc14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e16b5700 1 -- 172.21.15.88:0/829443003 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc1569d0 con 0x7f29dc0c7360 2024-09-13T18:06:43.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e16b5700 1 --2- 172.21.15.88:0/829443003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7360 0x7f29dc155b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd84d78102b0c200 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29d3fff700 1 -- 172.21.15.88:0/829443003 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8011830 con 0x7f29dc0c7360 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29d3fff700 1 -- 172.21.15.88:0/829443003 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d8011990 con 0x7f29dc0c7360 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29d3fff700 1 -- 172.21.15.88:0/829443003 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d8011d40 con 0x7f29dc0c7360 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- 172.21.15.88:0/829443003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7360 msgr2=0x7f29dc155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 --2- 172.21.15.88:0/829443003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7360 0x7f29dc155b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8009b60 comp rx=0 tx=0).stop 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- 172.21.15.88:0/829443003 shutdown_connections 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 --2- 172.21.15.88:0/829443003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7360 0x7f29dc155b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- 172.21.15.88:0/829443003 >> 172.21.15.88:0/829443003 conn(0x7f29dc0664b0 msgr2=0x7f29dc06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- 172.21.15.88:0/829443003 shutdown_connections 2024-09-13T18:06:43.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.627+0000 7f29e26b7700 1 -- 172.21.15.88:0/829443003 wait complete. 2024-09-13T18:06:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 Processor -- start 2024-09-13T18:06:43.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- start start 2024-09-13T18:06:43.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29dc0c14d0 0x7f29dc144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc0c7360 0x7f29dc06cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc148b60 con 0x7f29dc0c7740 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc149350 con 0x7f29dc0c7360 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc148880 con 0x7f29dc0c14d0 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46358/0 (socket says 172.21.15.88:46358) 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 -- 172.21.15.88:0/2652128691 learned_addr learned my addr 172.21.15.88:0/2652128691 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e16b5700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29dc0c14d0 0x7f29dc144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e0eb4700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc0c7360 0x7f29dc06cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29dc0c14d0 msgr2=0x7f29dc144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29dc0c14d0 0x7f29dc144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc0c7360 msgr2=0x7f29dc06cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc0c7360 0x7f29dc06cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80094b0 con 0x7f29dc0c7740 2024-09-13T18:06:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e0eb4700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc0c7360 0x7f29dc06cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:06:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e1eb6700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29d400cb40 tx=0x7f29d400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400a9e0 con 0x7f29dc0c7740 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400ab40 con 0x7f29dc0c7740 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400ce60 con 0x7f29dc0c7740 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc149070 con 0x7f29dc0c7740 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.631+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc06d400 con 0x7f29dc0c7740 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e26b7700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 0x7f29dc1459e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc068400 con 0x7f29dc147f40 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e16b5700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 0x7f29dc1459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e16b5700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f29dc159b10 con 0x7f29dc147f40 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f29d401b3b0 con 0x7f29dc0c7740 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e16b5700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 0x7f29dc1459e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f29c0066760 0x7f29c0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f29d4083be0 con 0x7f29dc0c7740 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d801f070 con 0x7f29dc147f40 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e0eb4700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f29c0066760 0x7f29c0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f29d8025420 con 0x7f29dc147f40 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 msgr2=0x7f29dc1459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 0x7f29dc1459e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f29d8009850 tx=0x7f29d8004770 comp rx=0 tx=0).stop 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 msgr2=0x7f29dc1459e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29d1ffb700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147f40 0x7f29dc1459e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.642 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.635+0000 7f29e0eb4700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f29c0066760 0x7f29c0068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29dc147ed0 tx=0x7f29cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 0x7f29dc14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.650 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc0c6de0 con 0x7f29dc147350 2024-09-13T18:06:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e16b5700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 0x7f29dc14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e16b5700 1 -- 172.21.15.88:0/2652128691 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f29dc0c5370 con 0x7f29dc147350 2024-09-13T18:06:43.651 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e16b5700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 0x7f29dc14e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8009240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.652 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d802dae0 con 0x7f29dc147350 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4948 (secure 0 0 0) 0x7f29d802dc40 con 0x7f29dc147350 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 msgr2=0x7f29dc14e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 0x7f29dc14e390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f29d8000c00 tx=0x7f29d8009240 comp rx=0 tx=0).stop 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 msgr2=0x7f29dc14e390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29d1ffb700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc147350 0x7f29dc14e390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:43.653 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.654 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:43.655 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.656 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:43.657 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:43.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.660 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:43.661 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:43.662 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.663 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:43.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:43.665 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:43.666 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.667 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:43.667 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:43.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f29c0066760 msgr2=0x7f29c0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f29c0066760 0x7f29c0068c20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f29dc147ed0 tx=0x7f29cc009040 comp rx=0 tx=0).stop 2024-09-13T18:06:43.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 msgr2=0x7f29dc1454a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f29d400cb40 tx=0x7f29d400cc20 comp rx=0 tx=0).stop 2024-09-13T18:06:43.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e1eb6700 1 -- 172.21.15.88:0/2652128691 reap_dead start 2024-09-13T18:06:43.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 shutdown_connections 2024-09-13T18:06:43.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 --2- 172.21.15.88:0/2652128691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f29dc0c7740 0x7f29dc1454a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 >> 172.21.15.88:0/2652128691 conn(0x7f29dc0664b0 msgr2=0x7f29dc158460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 shutdown_connections 2024-09-13T18:06:43.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.647+0000 7f29e26b7700 1 -- 172.21.15.88:0/2652128691 wait complete. 2024-09-13T18:06:43.670 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:43.670 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:06:43.670 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:06:43.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 Processor -- start 2024-09-13T18:06:43.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- start start 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ec00cbd10 0x7f7ec0152b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 0x7f7ec0153040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec0153580 con 0x7f7ec00cb930 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec006e0a0 con 0x7f7ec00cbd10 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec006d3c0 con 0x7f7ec00c7610 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ec00cbd10 0x7f7ec0152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ec00cb930 0x7f7ec00c6f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35634/0 (socket says 172.21.15.88:35634) 2024-09-13T18:06:43.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebffff700 1 -- 172.21.15.88:0/954483601 learned_addr learned my addr 172.21.15.88:0/954483601 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 -- 172.21.15.88:0/954483601 >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 msgr2=0x7f7ec0153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec486c700 1 --2- 172.21.15.88:0/954483601 >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 0x7f7ec0153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 --2- 172.21.15.88:0/954483601 >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 0x7f7ec0153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 -- 172.21.15.88:0/954483601 >> v1:172.21.15.88:6789/0 conn(0x7f7ec00cb930 legacy=0x7f7ec00c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebeffd700 1 -- 172.21.15.88:0/954483601 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015144080 0 0) 0x7f7ec0153580 con 0x7f7ec00cb930 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 -- 172.21.15.88:0/954483601 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0159120 con 0x7f7ec00cbd10 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec486c700 1 --2- 172.21.15.88:0/954483601 >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 0x7f7ec0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebf7fe700 1 --2- 172.21.15.88:0/954483601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec0152b00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ec006e3b0 tx=0x7f7eb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ab12302dc31fef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebeffd700 1 -- 172.21.15.88:0/954483601 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011830 con 0x7f7ec00cbd10 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebeffd700 1 -- 172.21.15.88:0/954483601 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4011990 con 0x7f7ec00cbd10 2024-09-13T18:06:43.790 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ebeffd700 1 -- 172.21.15.88:0/954483601 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4011d40 con 0x7f7ec00cbd10 2024-09-13T18:06:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- 172.21.15.88:0/954483601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 msgr2=0x7f7ec0152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 --2- 172.21.15.88:0/954483601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec0152b00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7ec006e3b0 tx=0x7f7eb4009b30 comp rx=0 tx=0).stop 2024-09-13T18:06:43.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- 172.21.15.88:0/954483601 shutdown_connections 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 --2- 172.21.15.88:0/954483601 >> v2:172.21.15.94:3300/0 conn(0x7f7ec00c7610 0x7f7ec0153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 --2- 172.21.15.88:0/954483601 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec0152b00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- 172.21.15.88:0/954483601 >> 172.21.15.88:0/954483601 conn(0x7f7ec00666c0 msgr2=0x7f7ec006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- 172.21.15.88:0/954483601 shutdown_connections 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.783+0000 7f7ec506d700 1 -- 172.21.15.88:0/954483601 wait complete. 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 Processor -- start 2024-09-13T18:06:43.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- start start 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ec00c7610 0x7f7ec01e1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec00cb930 0x7f7ec01df650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01500b0 con 0x7f7ec00cbd10 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01ee500 con 0x7f7ec00cb930 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec01ee770 con 0x7f7ec00c7610 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:46380/0 (socket says 172.21.15.88:46380) 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 -- 172.21.15.88:0/3428811075 learned_addr learned my addr 172.21.15.88:0/3428811075 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ebffff700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ec00c7610 0x7f7ec01e1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ebf7fe700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec00cb930 0x7f7ec01df650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ec00c7610 msgr2=0x7f7ec01e1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ec00c7610 0x7f7ec01e1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec00cb930 msgr2=0x7f7ec01df650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7ec00cb930 0x7f7ec01df650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40094b0 con 0x7f7ec00cbd10 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec486c700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cf20 tx=0x7f7eb800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800ae80 con 0x7f7ec00cbd10 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec01eea50 con 0x7f7ec00cbd10 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec01ef010 con 0x7f7ec00cbd10 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8007a00 con 0x7f7ec00cbd10 2024-09-13T18:06:43.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.787+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb801f640 con 0x7f7ec00cbd10 2024-09-13T18:06:43.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ec506d700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 0x7f7ea0004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0007f40 con 0x7f7ea0002a40 2024-09-13T18:06:43.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebffff700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 0x7f7ea0004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebffff700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ea0008100 con 0x7f7ea0002a40 2024-09-13T18:06:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebffff700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 0x7f7ea0004f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00011e0 tx=0x7f7eb0001870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7eb801f7a0 con 0x7f7ec00cbd10 2024-09-13T18:06:43.797 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7eac0666d0 0x7f7eac068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7eb8084750 con 0x7f7ec00cbd10 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb00114f0 con 0x7f7ea0002a40 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f7eb0011650 con 0x7f7ea0002a40 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 msgr2=0x7f7ea0004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 0x7f7ea0004f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7eb00011e0 tx=0x7f7eb0001870 comp rx=0 tx=0).stop 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 msgr2=0x7f7ea0004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebcff9700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0002a40 0x7f7ea0004f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebf7fe700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7eac0666d0 0x7f7eac068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.798 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.791+0000 7f7ebf7fe700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7eac0666d0 0x7f7eac068b90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0157ac0 tx=0x7f7eb4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ec506d700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 0x7f7ea0007490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea000a400 con 0x7f7ea0007020 2024-09-13T18:06:43.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ebffff700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 0x7f7ea0007490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ebffff700 1 -- 172.21.15.88:0/3428811075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f7ea000a5c0 con 0x7f7ea0007020 2024-09-13T18:06:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ebffff700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 0x7f7ea0007490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0005ac0 tx=0x7f7eb0001080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.803+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0021070 con 0x7f7ea0007020 2024-09-13T18:06:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4782 (secure 0 0 0) 0x7f7eb001ca90 con 0x7f7ea0007020 2024-09-13T18:06:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 msgr2=0x7f7ea0007490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.811 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ebcff9700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 0x7f7ea0007490 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0005ac0 tx=0x7f7eb0001080 comp rx=0 tx=0).stop 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ebcff9700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 msgr2=0x7f7ea0007490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ebcff9700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7ea0007020 0x7f7ea0007490 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 14, 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:06:43.812 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.813 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.814 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:06:43.815 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:06:43.816 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.817 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.818 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.819 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:06:43.820 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.822 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:06:43.823 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:06:43.824 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7eac0666d0 msgr2=0x7f7eac068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7eac0666d0 0x7f7eac068b90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0157ac0 tx=0x7f7eb4008030 comp rx=0 tx=0).stop 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 msgr2=0x7f7ec01e0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7eb800cf20 tx=0x7f7eb800a340 comp rx=0 tx=0).stop 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec486c700 1 -- 172.21.15.88:0/3428811075 reap_dead start 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 shutdown_connections 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 --2- 172.21.15.88:0/3428811075 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ec00cbd10 0x7f7ec01e0560 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 >> 172.21.15.88:0/3428811075 conn(0x7f7ec00666c0 msgr2=0x7f7ec0073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 shutdown_connections 2024-09-13T18:06:43.827 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.807+0000 7f7ec506d700 1 -- 172.21.15.88:0/3428811075 wait complete. 2024-09-13T18:06:43.827 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:06:43.827 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-13T18:06:43.827 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T18:06:43.827 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T18:06:43.827 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:06:43.828 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:06:43.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:06:43.866 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:06:43.866 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-13T18:06:43.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:43.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 Processor -- start 2024-09-13T18:06:43.987 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 -- start start 2024-09-13T18:06:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 0x7f546c0c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0c7f00 con 0x7f546c0c8e50 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c15a0f0 con 0x7f546c159720 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c155f20 con 0x7f546c0c8a70 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5470e26700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 msgr2=0x7f546c0c9e90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5470e26700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 0x7f546c0c9e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471e28700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:37290/0 (socket says 172.21.15.88:37290) 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471e28700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:49134/0 (socket says 172.21.15.88:49134) 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 -- 172.21.15.88:0/3385792410 learned_addr learned my addr 172.21.15.88:0/3385792410 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 -- 172.21.15.88:0/3385792410 >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 msgr2=0x7f546c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 --2- 172.21.15.88:0/3385792410 >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.990 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 -- 172.21.15.88:0/3385792410 >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 msgr2=0x7f546c0c9e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:43.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 --2- 172.21.15.88:0/3385792410 >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 0x7f546c0c9e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 -- 172.21.15.88:0/3385792410 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c156200 con 0x7f546c0c8a70 2024-09-13T18:06:43.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471e28700 1 --2- 172.21.15.88:0/3385792410 >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:43.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5471627700 1 --2- 172.21.15.88:0/3385792410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f546c0c3cc0 tx=0x7f545c00be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e71b31e5b87b961 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f546bfff700 1 -- 172.21.15.88:0/3385792410 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00dd30 con 0x7f546c0c8a70 2024-09-13T18:06:43.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f546bfff700 1 -- 172.21.15.88:0/3385792410 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00de90 con 0x7f546c0c8a70 2024-09-13T18:06:43.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f546bfff700 1 -- 172.21.15.88:0/3385792410 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c010690 con 0x7f546c0c8a70 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 -- 172.21.15.88:0/3385792410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 msgr2=0x7f546c0c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.983+0000 7f5472629700 1 --2- 172.21.15.88:0/3385792410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f546c0c3cc0 tx=0x7f545c00be90 comp rx=0 tx=0).stop 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- 172.21.15.88:0/3385792410 shutdown_connections 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- 172.21.15.88:0/3385792410 >> v2:172.21.15.94:3300/0 conn(0x7f546c159720 0x7f546c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- 172.21.15.88:0/3385792410 >> v2:172.21.15.88:3300/0 conn(0x7f546c0c8e50 0x7f546c0c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- 172.21.15.88:0/3385792410 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c0c9950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- 172.21.15.88:0/3385792410 >> 172.21.15.88:0/3385792410 conn(0x7f546c06a820 msgr2=0x7f546c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- 172.21.15.88:0/3385792410 shutdown_connections 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- 172.21.15.88:0/3385792410 wait complete. 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 Processor -- start 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- start start 2024-09-13T18:06:43.996 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 0x7f546c06f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 0x7f546c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c0c5b30 con 0x7f546c0c8e50 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c1588c0 con 0x7f546c159720 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5472629700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c06efd0 con 0x7f546c0c8a70 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5470e26700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 msgr2=0x7f546c06f420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5470e26700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 0x7f546c06f420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471627700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 0x7f546c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471627700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:37300/0 (socket says 172.21.15.88:37300) 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471627700 1 -- 172.21.15.88:0/3862690579 learned_addr learned my addr 172.21.15.88:0/3862690579 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:43.997 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 -- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 msgr2=0x7f546c14bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 -- 172.21.15.88:0/3862690579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 msgr2=0x7f546c06f420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 0x7f546c06f420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 -- 172.21.15.88:0/3862690579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009a70 con 0x7f546c159720 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471627700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.987+0000 7f5471e28700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 0x7f546c06f960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5464009db0 tx=0x7f546400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464009c20 con 0x7f546c159720 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c00b810 con 0x7f546c159720 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400f040 con 0x7f546c159720 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400cd60 con 0x7f546c159720 2024-09-13T18:06:43.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c1585e0 con 0x7f546c159720 2024-09-13T18:06:43.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544c005310 con 0x7f546c159720 2024-09-13T18:06:43.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5464003a40 con 0x7f546c159720 2024-09-13T18:06:44.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 0x7f5458068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:44.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f54640851b0 con 0x7f546c159720 2024-09-13T18:06:44.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5471627700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 0x7f5458068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:44.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.991+0000 7f5471627700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 0x7f5458068ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f545c00b360 tx=0x7f545c013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:44.006 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:43.999+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5464052410 con 0x7f546c159720 2024-09-13T18:06:44.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.227+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f544c005890 con 0x7f546c159720 2024-09-13T18:06:44.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.227+0000 7f5469ffb700 1 -- 172.21.15.88:0/3862690579 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f5464018080 con 0x7f546c159720 2024-09-13T18:06:44.232 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 msgr2=0x7f5458068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 0x7f5458068ba0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f545c00b360 tx=0x7f545c013000 comp rx=0 tx=0).stop 2024-09-13T18:06:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 msgr2=0x7f546c06f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 0x7f546c06f960 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5464009db0 tx=0x7f546400c3a0 comp rx=0 tx=0).stop 2024-09-13T18:06:44.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 shutdown_connections 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f54580666e0 0x7f5458068ba0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f546c159720 0x7f546c06f960 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f546c0c8e50 0x7f546c06f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 --2- 172.21.15.88:0/3862690579 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f546c0c8a70 0x7f546c14bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 >> 172.21.15.88:0/3862690579 conn(0x7f546c06a820 msgr2=0x7f546c14f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 shutdown_connections 2024-09-13T18:06:44.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:44.231+0000 7f5472629700 1 -- 172.21.15.88:0/3862690579 wait complete. 2024-09-13T18:06:47.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:47.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 Processor -- start 2024-09-13T18:06:47.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 -- start start 2024-09-13T18:06:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5c3c0c8e50 0x7f5c3c159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 0x7f5c3c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c3c155f20 con 0x7f5c3c0c8a70 2024-09-13T18:06:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c7f00 con 0x7f5c3c0ca060 2024-09-13T18:06:47.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c42de9700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c156200 con 0x7f5c3c0c8e50 2024-09-13T18:06:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c41de7700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f5c3c0c8a70 legacy=0x7f5c3c0c9950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c425e8700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 msgr2=0x7f5c3c159c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.335+0000 7f5c425e8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 0x7f5c3c159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:47.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5c3c0c8e50 0x7f5c3c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5c3c0c8e50 0x7f5c3c159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:49138/0 (socket says 172.21.15.88:49138) 2024-09-13T18:06:47.345 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 -- 172.21.15.88:0/2585542860 learned_addr learned my addr 172.21.15.88:0/2585542860 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:47.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 -- 172.21.15.88:0/2585542860 >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 msgr2=0x7f5c3c159c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:47.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 --2- 172.21.15.88:0/2585542860 >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 0x7f5c3c159c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 -- 172.21.15.88:0/2585542860 >> v1:172.21.15.88:6789/0 conn(0x7f5c3c0c8a70 legacy=0x7f5c3c0c9950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:47.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 -- 172.21.15.88:0/2585542860 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c1564e0 con 0x7f5c3c0c8e50 2024-09-13T18:06:47.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c415e6700 1 --2- 172.21.15.88:0/2585542860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8e50 0x7f5c3c159720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cb730 tx=0x7f5c30009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a55421cfd7bb91c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c40de5700 1 -- 172.21.15.88:0/2585542860 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30004230 con 0x7f5c3c0c8e50 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c40de5700 1 -- 172.21.15.88:0/2585542860 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30004390 con 0x7f5c3c0c8e50 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c40de5700 1 -- 172.21.15.88:0/2585542860 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c300036c0 con 0x7f5c3c0c8e50 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- 172.21.15.88:0/2585542860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8e50 msgr2=0x7f5c3c159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 --2- 172.21.15.88:0/2585542860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8e50 0x7f5c3c159720 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cb730 tx=0x7f5c30009bf0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- 172.21.15.88:0/2585542860 shutdown_connections 2024-09-13T18:06:47.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 --2- 172.21.15.88:0/2585542860 >> v2:172.21.15.88:3300/0 conn(0x7f5c3c0ca060 0x7f5c3c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 --2- 172.21.15.88:0/2585542860 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8e50 0x7f5c3c159720 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cb730 tx=0x7f5c30009bf0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- 172.21.15.88:0/2585542860 >> 172.21.15.88:0/2585542860 conn(0x7f5c3c06a820 msgr2=0x7f5c3c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:47.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- 172.21.15.88:0/2585542860 shutdown_connections 2024-09-13T18:06:47.355 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- 172.21.15.88:0/2585542860 wait complete. 2024-09-13T18:06:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 Processor -- start 2024-09-13T18:06:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.339+0000 7f5c42de9700 1 -- start start 2024-09-13T18:06:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8a70 0x7f5c3c1587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 0x7f5c3c14ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.356 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c1504d0 con 0x7f5c3c0ca060 2024-09-13T18:06:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c06fdf0 con 0x7f5c3c0c8a70 2024-09-13T18:06:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c158e70 con 0x7f5c3c150c00 2024-09-13T18:06:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c415e6700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 msgr2=0x7f5c3c14ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:47.357 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c415e6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 0x7f5c3c14ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c41de7700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8a70 0x7f5c3c1587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:37316/0 (socket says 172.21.15.88:37316) 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 -- 172.21.15.88:0/3151881396 learned_addr learned my addr 172.21.15.88:0/3151881396 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 -- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8a70 msgr2=0x7f5c3c1587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8a70 0x7f5c3c1587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 -- 172.21.15.88:0/3151881396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 msgr2=0x7f5c3c14ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:47.358 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 0x7f5c3c14ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 -- 172.21.15.88:0/3151881396 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30009570 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c425e8700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b480 tx=0x7f5c2c00b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c003e70 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c0060d0 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c006480 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c149ca0 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c14a260 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.343+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c14a450 con 0x7f5c3c150c00 2024-09-13T18:06:47.359 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.347+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5c2c0065e0 con 0x7f5c3c150c00 2024-09-13T18:06:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.347+0000 7f5c3a7fc700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 0x7f5c28068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.347+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5c2c0835c0 con 0x7f5c3c150c00 2024-09-13T18:06:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.347+0000 7f5c41de7700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 0x7f5c28068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.347+0000 7f5c41de7700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 0x7f5c28068bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009420 tx=0x7f5c3400d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:47.360 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.355+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5c2c0508b0 con 0x7f5c3c150c00 2024-09-13T18:06:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f5c3c0c35c0 con 0x7f5c3c150c00 2024-09-13T18:06:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c3a7fc700 1 -- 172.21.15.88:0/3151881396 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f5c2c017020 con 0x7f5c3c150c00 2024-09-13T18:06:47.616 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 msgr2=0x7f5c28068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 0x7f5c28068bd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009420 tx=0x7f5c3400d040 comp rx=0 tx=0).stop 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 msgr2=0x7f5c3c06f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00b480 tx=0x7f5c2c00b790 comp rx=0 tx=0).stop 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 shutdown_connections 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5c28066710 0x7f5c28068bd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5c3c150c00 0x7f5c3c06f110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c3c0ca060 0x7f5c3c14ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 --2- 172.21.15.88:0/3151881396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5c3c0c8a70 0x7f5c3c1587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 >> 172.21.15.88:0/3151881396 conn(0x7f5c3c06a820 msgr2=0x7f5c3c154630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 shutdown_connections 2024-09-13T18:06:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:47.611+0000 7f5c42de9700 1 -- 172.21.15.88:0/3151881396 wait complete. 2024-09-13T18:06:50.629 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:50.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 Processor -- start 2024-09-13T18:06:50.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 -- start start 2024-09-13T18:06:50.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 0x7f1f2c15cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f2c0c39d0 0x7f1f2c159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f2c153780 con 0x7f1f2c1533a0 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0b20d0 con 0x7f1f2c0c3f20 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2b59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f2c0c9d20 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f23fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 msgr2=0x7f1f2c15cf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f23fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 0x7f1f2c15cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.726+0000 7f1f2ad9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f2c0c39d0 0x7f1f2c159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2a59c700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f1f2c1533a0 0x7f1f2c0cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:45080/0 (socket says 172.21.15.88:45080) 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1f2c0c39d0 0x7f1f2c159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:44530/0 (socket says 172.21.15.88:44530) 2024-09-13T18:06:50.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2a59c700 1 -- 172.21.15.88:0/1723415339 learned_addr learned my addr 172.21.15.88:0/1723415339 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/1723415339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 msgr2=0x7f1f2c15cf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/1723415339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 0x7f1f2c15cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/1723415339 >> v1:172.21.15.94:6789/0 conn(0x7f1f2c1533a0 legacy=0x7f1f2c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/1723415339 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f2c0c9760 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/1723415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c159320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0c8f50 tx=0x7f1f2400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ea050c323ac268d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f29d9b700 1 -- 172.21.15.88:0/1723415339 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2400e070 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f29d9b700 1 -- 172.21.15.88:0/1723415339 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2400bbd0 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f29d9b700 1 -- 172.21.15.88:0/1723415339 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24012430 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- 172.21.15.88:0/1723415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c39d0 msgr2=0x7f1f2c159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/1723415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c159320 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c0c8f50 tx=0x7f1f2400b330 comp rx=0 tx=0).stop 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- 172.21.15.88:0/1723415339 shutdown_connections 2024-09-13T18:06:50.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/1723415339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c159320 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/1723415339 >> v2:172.21.15.88:3300/0 conn(0x7f1f2c0c3f20 0x7f1f2c15cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- 172.21.15.88:0/1723415339 >> 172.21.15.88:0/1723415339 conn(0x7f1f2c071800 msgr2=0x7f1f2c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- 172.21.15.88:0/1723415339 shutdown_connections 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- 172.21.15.88:0/1723415339 wait complete. 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 Processor -- start 2024-09-13T18:06:50.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.730+0000 7f1f2b59e700 1 -- start start 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c1497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 0x7f1f2c14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c154e20 con 0x7f1f2c0c39d0 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c158ba0 con 0x7f1f2c0c3f20 2024-09-13T18:06:50.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2c14ea40 con 0x7f1f2c1533a0 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2a59c700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 msgr2=0x7f1f2c1497e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c1497e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f23fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f23fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:44534/0 (socket says 172.21.15.88:44534) 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f23fff700 1 -- 172.21.15.88:0/3747605351 learned_addr learned my addr 172.21.15.88:0/3747605351 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 0x7f1f2c14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 msgr2=0x7f1f2c14d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/3747605351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 msgr2=0x7f1f2c1497e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c1497e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 -- 172.21.15.88:0/3747605351 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24009a70 con 0x7f1f2c1533a0 2024-09-13T18:06:50.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f23fff700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2ad9d700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 0x7f1f2c14db80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f24016000 tx=0x7f1f24004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24012430 con 0x7f1f2c1533a0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f2c14ed00 con 0x7f1f2c1533a0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f24020070 con 0x7f1f2c1533a0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f24004280 con 0x7f1f2c1533a0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f2c158550 con 0x7f1f2c1533a0 2024-09-13T18:06:50.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.734+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2c15cf50 con 0x7f1f2c1533a0 2024-09-13T18:06:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.738+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1f240043e0 con 0x7f1f2c1533a0 2024-09-13T18:06:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.738+0000 7f1f22ffd700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 0x7f1f0c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.738+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1f24022070 con 0x7f1f2c1533a0 2024-09-13T18:06:50.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.738+0000 7f1f2a59c700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 0x7f1f0c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:50.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.738+0000 7f1f2a59c700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 0x7f1f0c068ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0048c0 tx=0x7f1f1c007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:06:50.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.746+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1f24053990 con 0x7f1f2c1533a0 2024-09-13T18:06:50.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.966+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f1f2c157180 con 0x7f1f2c1533a0 2024-09-13T18:06:50.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.966+0000 7f1f22ffd700 1 -- 172.21.15.88:0/3747605351 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f1f2402c620 con 0x7f1f2c1533a0 2024-09-13T18:06:50.974 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":14,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 msgr2=0x7f1f0c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 0x7f1f0c068ba0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0048c0 tx=0x7f1f1c007b90 comp rx=0 tx=0).stop 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 msgr2=0x7f1f2c14db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 0x7f1f2c14db80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1f24016000 tx=0x7f1f24004af0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 shutdown_connections 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1f0c0666e0 0x7f1f0c068ba0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1f2c1533a0 0x7f1f2c14db80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1f2c0c3f20 0x7f1f2c14d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 --2- 172.21.15.88:0/3747605351 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f2c0c39d0 0x7f1f2c1497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 >> 172.21.15.88:0/3747605351 conn(0x7f1f2c071800 msgr2=0x7f1f2c0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:06:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 shutdown_connections 2024-09-13T18:06:50.978 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:50.970+0000 7f1f2b59e700 1 -- 172.21.15.88:0/3747605351 wait complete. 2024-09-13T18:06:53.991 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:06:54.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 Processor -- start 2024-09-13T18:06:54.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 -- start start 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701815c540 con 0x7f7018070b20 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701815c820 con 0x7f701806f290 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.078+0000 7f701e7de700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701815cb00 con 0x7f7018153280 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701cfdb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:41732/0 (socket says 172.21.15.88:41732) 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 learned_addr learned my addr 172.21.15.88:0/3363846413 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:06:54.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.082+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:54.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.286+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:54.696 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:54.690+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:06:55.500 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:55.494+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.078+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 msgr2=0x7f70180cb720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.078+0000 7f700effd700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7018153280 0x7f70180cb720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.078+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 msgr2=0x7f70180cbc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.078+0000 7f700effd700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.94:3300/0 conn(0x7f701806f290 0x7f70180cbc60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.078+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.94:6789/0 conn(0x7f7018070b20 legacy=0x7f70180c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:06:57.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f700effd700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:06:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701815cde0 con 0x7f6ffc0062a0 2024-09-13T18:06:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701815c820 con 0x7f6ffc003760 2024-09-13T18:06:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 msgr2=0x7f6ffc005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0062a0 legacy=0x7f6ffc008740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:57.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.082+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:06:57.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.286+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0062a0 legacy=0x7f6ffc008740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:57.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.286+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 msgr2=0x7f6ffc005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:57.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.286+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:06:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.690+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 msgr2=0x7f6ffc005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.690+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0062a0 legacy=0x7f6ffc008740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:57.695 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:57.690+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'. 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T18:06:57.986 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr: 2024-09-13T18:06:57.987 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at 6c6b083f148 Merge PR #56690 into wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:06:57.992 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T18:06:58.026 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T18:06:58.029 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:06:58.029 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T18:06:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:58.494+0000 7f701d7dc700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 msgr2=0x7f6ffc005bc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:06:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:58.494+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0062a0 legacy=0x7f6ffc008740 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:06:58.499 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:06:58.494+0000 7f701d7dc700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:06:58.871 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T18:06:58.949 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T18:06:59.012 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T18:06:59.013 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:06:59.014 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T18:06:59.075 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T18:06:59.080 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:06:59.080 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T18:06:59.085 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-13T18:06:59.086 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-13T18:06:59.086 DEBUG:teuthology.orchestra.run.smithi088:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-13T18:06:59.115 INFO:tasks.workunit.client.0.smithi088.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Version $Revision: 3.489 $ 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Compiled for 64 bit mode. 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Build: linux-AMD64 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:06:59.195 INFO:tasks.workunit.client.0.smithi088.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Run began: Fri Sep 13 18:06:59 2024 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Include close in write timing 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Include fsync in write timing 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: File size set to 1048576 kB 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Record Size 16 kB 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Output is in kBytes/sec 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:06:59.196 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:06:59.197 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:06:59.197 INFO:tasks.workunit.client.0.smithi088.stdout: File stride size set to 17 * record size. 2024-09-13T18:06:59.197 INFO:tasks.workunit.client.0.smithi088.stdout: Throughput test with 1 process 2024-09-13T18:06:59.197 INFO:tasks.workunit.client.0.smithi088.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-13T18:07:00.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 msgr2=0x7f6ffc005bc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 --2- 172.21.15.88:0/3363846413 >> v2:172.21.15.88:3300/0 conn(0x7f6ffc003760 0x7f6ffc005bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0062a0 legacy=0x7f6ffc008740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701dfdd700 1 -- 172.21.15.88:0/3363846413 reap_dead start 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 0x7f6ffc005bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ffc00b020 con 0x7f6ffc0086f0 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701815cde0 con 0x7f6ffc008e70 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700effd700 1 -- 172.21.15.88:0/3363846413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701815c820 con 0x7f6ffc009960 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701dfdd700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0086f0 legacy=0x7f6ffc00d420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 0x7f6ffc005bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.94:6789/0 conn(0x7f6ffc008e70 legacy=0x7f6ffc009250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 >> v1:172.21.15.88:6789/0 conn(0x7f6ffc0086f0 legacy=0x7f6ffc00d420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700ffff700 1 -- 172.21.15.88:0/3363846413 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595577419 0 0) 0x7f701815cde0 con 0x7f6ffc008e70 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701cfdb700 1 -- 172.21.15.88:0/3363846413 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc010bf0 con 0x7f6ffc009960 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701cfdb700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 0x7f6ffc005bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f700800cb30 tx=0x7f700800ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f858e3b3c63abee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700ffff700 1 -- 172.21.15.88:0/3363846413 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008004230 con 0x7f6ffc009960 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700ffff700 1 -- 172.21.15.88:0/3363846413 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700800c040 con 0x7f6ffc009960 2024-09-13T18:07:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f700ffff700 1 -- 172.21.15.88:0/3363846413 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080148e0 con 0x7f6ffc009960 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 -- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 msgr2=0x7f6ffc005bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 0x7f6ffc005bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f700800cb30 tx=0x7f700800ce40 comp rx=0 tx=0).stop 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 -- 172.21.15.88:0/3363846413 shutdown_connections 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 --2- 172.21.15.88:0/3363846413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc009960 0x7f6ffc005bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 -- 172.21.15.88:0/3363846413 >> 172.21.15.88:0/3363846413 conn(0x7f70180717d0 msgr2=0x7f7018071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 -- 172.21.15.88:0/3363846413 shutdown_connections 2024-09-13T18:07:00.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.082+0000 7f701e7de700 1 -- 172.21.15.88:0/3363846413 wait complete. 2024-09-13T18:07:00.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.086+0000 7f701e7de700 1 Processor -- start 2024-09-13T18:07:00.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.086+0000 7f701e7de700 1 -- start start 2024-09-13T18:07:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 0x7f7018155d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 0x7f70180cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70180cd320 con 0x7f6ffc008e70 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7018155830 con 0x7f6ffc009960 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70180cd590 con 0x7f6ffc0086f0 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701cfdb700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 msgr2=0x7f7018155d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701cfdb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 0x7f7018155d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:41784/0 (socket says 172.21.15.88:41784) 2024-09-13T18:07:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 -- 172.21.15.88:0/902446832 learned_addr learned my addr 172.21.15.88:0/902446832 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701dfdd700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 0x7f70180cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 -- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 msgr2=0x7f70180cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 0x7f70180cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 -- 172.21.15.88:0/902446832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 msgr2=0x7f7018155d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 0x7f7018155d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 -- 172.21.15.88:0/902446832 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700800c790 con 0x7f6ffc0086f0 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701dfdd700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 0x7f70180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:00.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701d7dc700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7014013980 tx=0x7f7014013c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011950 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701400c040 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70180c6e90 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7014011cf0 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.090+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70180c7450 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701806eea0 con 0x7f6ffc0086f0 2024-09-13T18:07:00.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f7014016460 con 0x7f6ffc0086f0 2024-09-13T18:07:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f700dffb700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 0x7f6ffc06a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7014084440 con 0x7f6ffc0086f0 2024-09-13T18:07:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f701cfdb700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 0x7f6ffc06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.094+0000 7f701cfdb700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 0x7f6ffc06a920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f70180c9ed0 tx=0x7f7008018000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.102+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f7014051740 con 0x7f6ffc0086f0 2024-09-13T18:07:00.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f70180c9c20 con 0x7f6ffc0086f0 2024-09-13T18:07:00.379 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f700dffb700 1 -- 172.21.15.88:0/902446832 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1533 (secure 0 0 0) 0x7f7014054d60 con 0x7f6ffc0086f0 2024-09-13T18:07:00.380 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":18,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":2,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 msgr2=0x7f6ffc06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 0x7f6ffc06a920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f70180c9ed0 tx=0x7f7008018000 comp rx=0 tx=0).stop 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 msgr2=0x7f70180ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7014013980 tx=0x7f7014013c90 comp rx=0 tx=0).stop 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 shutdown_connections 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6ffc068460 0x7f6ffc06a920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ffc009960 0x7f70180cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ffc008e70 0x7f7018155d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.385 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 --2- 172.21.15.88:0/902446832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ffc0086f0 0x7f70180ccde0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.374+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 >> 172.21.15.88:0/902446832 conn(0x7f70180717d0 msgr2=0x7f70181524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.378+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 shutdown_connections 2024-09-13T18:07:00.386 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.378+0000 7f701e7de700 1 -- 172.21.15.88:0/902446832 wait complete. 2024-09-13T18:07:00.395 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-13T18:07:00.396 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-13T18:07:00.396 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:07:00.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 Processor -- start 2024-09-13T18:07:00.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 -- start start 2024-09-13T18:07:00.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 0x7f65040c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6504070000 con 0x7f65040b0b00 2024-09-13T18:07:00.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040705c0 con 0x7f650414f390 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650b37c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6504155760 con 0x7f65041551e0 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650a37a700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 msgr2=0x7f65040c6970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650a37a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 0x7f65040c6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.550+0000 7f650ab7b700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f65040b0b00 legacy=0x7f6504070a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:51980/0 (socket says 172.21.15.88:51980) 2024-09-13T18:07:00.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 -- 172.21.15.88:0/1606855979 learned_addr learned my addr 172.21.15.88:0/1606855979 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:00.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 -- 172.21.15.88:0/1606855979 >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 msgr2=0x7f65040c6970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 --2- 172.21.15.88:0/1606855979 >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 0x7f65040c6970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 -- 172.21.15.88:0/1606855979 >> v1:172.21.15.88:6789/0 conn(0x7f65040b0b00 legacy=0x7f6504070a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 -- 172.21.15.88:0/1606855979 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504155a20 con 0x7f65041551e0 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509b79700 1 --2- 172.21.15.88:0/1606855979 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64f400bbc0 tx=0x7f64f400bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbaa9ea4ae836a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509378700 1 -- 172.21.15.88:0/1606855979 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f400dc00 con 0x7f65041551e0 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509378700 1 -- 172.21.15.88:0/1606855979 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f400dd60 con 0x7f65041551e0 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f6509378700 1 -- 172.21.15.88:0/1606855979 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4017640 con 0x7f65041551e0 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 -- 172.21.15.88:0/1606855979 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 msgr2=0x7f65040c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 --2- 172.21.15.88:0/1606855979 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f64f400bbc0 tx=0x7f64f400bed0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 -- 172.21.15.88:0/1606855979 shutdown_connections 2024-09-13T18:07:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 --2- 172.21.15.88:0/1606855979 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65040c6eb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 --2- 172.21.15.88:0/1606855979 >> v2:172.21.15.88:3300/0 conn(0x7f650414f390 0x7f65040c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 -- 172.21.15.88:0/1606855979 >> 172.21.15.88:0/1606855979 conn(0x7f65040cb590 msgr2=0x7f65040c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 -- 172.21.15.88:0/1606855979 shutdown_connections 2024-09-13T18:07:00.566 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.554+0000 7f650b37c700 1 -- 172.21.15.88:0/1606855979 wait complete. 2024-09-13T18:07:00.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 Processor -- start 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 -- start start 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650414f390 0x7f6504150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65041510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650414de10 con 0x7f650414f390 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650414e6a0 con 0x7f65040b0b00 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650b37c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65040cadd0 con 0x7f65041551e0 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f6509b79700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650414f390 msgr2=0x7f6504150b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f6509b79700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650414f390 0x7f6504150b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650ab7b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65041510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:57904/0 (socket says 172.21.15.88:57904) 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 -- 172.21.15.88:0/3149273136 learned_addr learned my addr 172.21.15.88:0/3149273136 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:00.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 msgr2=0x7f65041510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65041551e0 0x7f65041510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650414f390 msgr2=0x7f6504150b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f650414f390 0x7f6504150b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f400b820 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.558+0000 7f650a37a700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f650000b7b0 tx=0x7f650000bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500003e70 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500005070 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65040ca850 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500005440 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65040caaf0 con 0x7f65040b0b00 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f650b37c700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 0x7f65041edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504068400 con 0x7f65040c1d20 2024-09-13T18:07:00.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f6509b79700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 0x7f65041edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f6509b79700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f65040c1930 con 0x7f65040c1d20 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f65000055a0 con 0x7f65040b0b00 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f6509b79700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 0x7f65041edf60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64f400bbc0 tx=0x7f64f4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f64e80666e0 0x7f64e8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6500083ca0 con 0x7f65040b0b00 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f650ab7b700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f64e80666e0 0x7f64e8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f4017cc0 con 0x7f65040c1d20 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f64f4017e20 con 0x7f65040c1d20 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 msgr2=0x7f65041edf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.562+0000 7f64faffd700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 0x7f65041edf60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f64f400bbc0 tx=0x7f64f4004770 comp rx=0 tx=0).stop 2024-09-13T18:07:00.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.566+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 msgr2=0x7f65041edf60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.566+0000 7f64faffd700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040c1d20 0x7f65041edf60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.566+0000 7f650ab7b700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f64e80666e0 0x7f64e8068ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64fc003db0 tx=0x7f64fc0095f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.574+0000 7f650b37c700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 0x7f65041ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.574+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650414f150 con 0x7f65040ca380 2024-09-13T18:07:00.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.574+0000 7f6509b79700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 0x7f65041ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f6509b79700 1 -- 172.21.15.88:0/3149273136 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f6504070250 con 0x7f65040ca380 2024-09-13T18:07:00.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f6509b79700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 0x7f65041ee4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f65041537c0 tx=0x7f64f401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f402a7c0 con 0x7f65040ca380 2024-09-13T18:07:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4938 (secure 0 0 0) 0x7f64f402a920 con 0x7f65040ca380 2024-09-13T18:07:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 msgr2=0x7f65041ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 0x7f65041ee4a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f65041537c0 tx=0x7f64f401f000 comp rx=0 tx=0).stop 2024-09-13T18:07:00.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 msgr2=0x7f65041ee4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.585 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.586 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.587 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:00.588 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.589 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:00.590 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.591 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.592 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.593 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:00.594 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.595 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:00.597 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.598 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:00.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.599 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.599 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:00.599 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f64faffd700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040ca380 0x7f65041ee4a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f64e80666e0 msgr2=0x7f64e8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f64e80666e0 0x7f64e8068ba0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64fc003db0 tx=0x7f64fc0095f0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 msgr2=0x7f650414d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f650000b7b0 tx=0x7f650000bac0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650ab7b700 1 -- 172.21.15.88:0/3149273136 reap_dead start 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 shutdown_connections 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 --2- 172.21.15.88:0/3149273136 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65040b0b00 0x7f650414d8d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 >> 172.21.15.88:0/3149273136 conn(0x7f65040cb590 msgr2=0x7f650406f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 shutdown_connections 2024-09-13T18:07:00.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.578+0000 7f650b37c700 1 -- 172.21.15.88:0/3149273136 wait complete. 2024-09-13T18:07:00.601 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:07:00.601 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-13T18:07:00.602 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:07:00.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a748c700 1 Processor -- start 2024-09-13T18:07:00.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a748c700 1 -- start start 2024-09-13T18:07:00.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a748c700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50a00c7800 0x7f50a00c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a748c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 0x7f50a0156c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a748c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0157140 con 0x7f50a00c7420 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.722+0000 7f50a648a700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7f50a00c7420 legacy=0x7f50a00c9240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00c64a0 con 0x7f50a00c3cb0 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00c41a0 con 0x7f50a00c7800 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a6c8b700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 msgr2=0x7f50a0156c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:00.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a6c8b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 0x7f50a0156c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50a00c7800 0x7f50a00c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50a00c7800 0x7f50a00c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:57930/0 (socket says 172.21.15.88:57930) 2024-09-13T18:07:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 -- 172.21.15.88:0/2678730787 learned_addr learned my addr 172.21.15.88:0/2678730787 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:00.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 -- 172.21.15.88:0/2678730787 >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 msgr2=0x7f50a0156c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 --2- 172.21.15.88:0/2678730787 >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 0x7f50a0156c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 -- 172.21.15.88:0/2678730787 >> v1:172.21.15.88:6789/0 conn(0x7f50a00c7420 legacy=0x7f50a00c9240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 -- 172.21.15.88:0/2678730787 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00c4480 con 0x7f50a00c7800 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5c89700 1 --2- 172.21.15.88:0/2678730787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c7800 0x7f50a00c6930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50a0157d90 tx=0x7f5090009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8423234bad3a2968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5488700 1 -- 172.21.15.88:0/2678730787 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090004230 con 0x7f50a00c7800 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5488700 1 -- 172.21.15.88:0/2678730787 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090004390 con 0x7f50a00c7800 2024-09-13T18:07:00.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a5488700 1 -- 172.21.15.88:0/2678730787 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900036c0 con 0x7f50a00c7800 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- 172.21.15.88:0/2678730787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c7800 msgr2=0x7f50a00c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 --2- 172.21.15.88:0/2678730787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c7800 0x7f50a00c6930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50a0157d90 tx=0x7f5090009bf0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- 172.21.15.88:0/2678730787 shutdown_connections 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 --2- 172.21.15.88:0/2678730787 >> v2:172.21.15.88:3300/0 conn(0x7f50a00c3cb0 0x7f50a0156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 --2- 172.21.15.88:0/2678730787 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c7800 0x7f50a00c6930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- 172.21.15.88:0/2678730787 >> 172.21.15.88:0/2678730787 conn(0x7f50a0066090 msgr2=0x7f50a00664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- 172.21.15.88:0/2678730787 shutdown_connections 2024-09-13T18:07:00.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.726+0000 7f50a748c700 1 -- 172.21.15.88:0/2678730787 wait complete. 2024-09-13T18:07:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 Processor -- start 2024-09-13T18:07:00.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 -- start start 2024-09-13T18:07:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 0x7f50a014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00c7420 0x7f50a014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00c7800 0x7f50a014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a014ffc0 con 0x7f50a00c7420 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0148f10 con 0x7f50a00c3cb0 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a748c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01ef3b0 con 0x7f50a00c7800 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a5c89700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00c7420 msgr2=0x7f50a014b200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a5c89700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00c7420 0x7f50a014b200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 0x7f50a014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a6c8b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00c7800 0x7f50a014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 0x7f50a014f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:57944/0 (socket says 172.21.15.88:57944) 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 -- 172.21.15.88:0/1507908421 learned_addr learned my addr 172.21.15.88:0/1507908421 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00c7800 msgr2=0x7f50a014b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00c7800 0x7f50a014b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00c7420 msgr2=0x7f50a014b200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:00.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.730+0000 7f50a648a700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f50a00c7420 0x7f50a014b200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a648a700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009570 con 0x7f50a00c3cb0 2024-09-13T18:07:00.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a6c8b700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00c7800 0x7f50a014b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a648a700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 0x7f50a014f680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f509c00b780 tx=0x7f509c00ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c003e70 con 0x7f50a00c3cb0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c005070 con 0x7f50a00c3cb0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a01ef690 con 0x7f50a00c3cb0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c005420 con 0x7f50a00c3cb0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a0150210 con 0x7f50a00c3cb0 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a748c700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 0x7f50a0140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0068200 con 0x7f50a0149310 2024-09-13T18:07:00.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a5c89700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 0x7f50a0140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a5c89700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50a01ef880 con 0x7f50a0149310 2024-09-13T18:07:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f50a5c89700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 0x7f50a0140ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5090004700 tx=0x7f5090004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.734+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000b660 con 0x7f50a0149310 2024-09-13T18:07:00.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f509c005580 con 0x7f50a00c3cb0 2024-09-13T18:07:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f50840667d0 0x7f5084068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f509c083bd0 con 0x7f50a00c3cb0 2024-09-13T18:07:00.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f509000b7c0 con 0x7f50a0149310 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 msgr2=0x7f50a0140ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 0x7f50a0140ea0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5090004700 tx=0x7f5090004770 comp rx=0 tx=0).stop 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 msgr2=0x7f50a0140ea0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f5096ffd700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0149310 0x7f50a0140ea0 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5090004700 tx=0x7f5090004770 comp rx=0 tx=0).stop 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f50a6c8b700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f50840667d0 0x7f5084068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.738+0000 7f50a6c8b700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f50840667d0 0x7f5084068c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50a01476b0 tx=0x7f509800d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.750+0000 7f50a748c700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 0x7f50a01413e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.750+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c4e70 con 0x7f50a0154400 2024-09-13T18:07:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.750+0000 7f50a5c89700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 0x7f50a01413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.750+0000 7f50a5c89700 1 -- 172.21.15.88:0/1507908421 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f50a00c6130 con 0x7f50a0154400 2024-09-13T18:07:00.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a5c89700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 0x7f50a01413e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f50900092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:00.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090028070 con 0x7f50a0154400 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4770 (secure 0 0 0) 0x7f509000be60 con 0x7f50a0154400 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 msgr2=0x7f50a01413e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 0x7f50a01413e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f50900092e0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 msgr2=0x7f50a01413e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f5096ffd700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a0154400 0x7f50a01413e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:00.760 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 18, 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 2, 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.761 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.762 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:00.763 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:00.764 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.765 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.766 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.768 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.770 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:00.772 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:00.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f50840667d0 msgr2=0x7f5084068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f50840667d0 0x7f5084068c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50a01476b0 tx=0x7f509800d040 comp rx=0 tx=0).stop 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 msgr2=0x7f50a014f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 --2- 172.21.15.88:0/1507908421 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00c3cb0 0x7f50a014f680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f509c00b780 tx=0x7f509c00ba90 comp rx=0 tx=0).stop 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a6c8b700 1 -- 172.21.15.88:0/1507908421 reap_dead start 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a6c8b700 1 -- 172.21.15.88:0/1507908421 reap_dead start 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 shutdown_connections 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 >> 172.21.15.88:0/1507908421 conn(0x7f50a0066090 msgr2=0x7f50a0149800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 shutdown_connections 2024-09-13T18:07:00.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:00.754+0000 7f50a748c700 1 -- 172.21.15.88:0/1507908421 wait complete. 2024-09-13T18:07:00.777 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:07:00.777 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T18:07:03.742 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:07:03.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:07:17.867 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 initial writers = 56170.24 kB/sec 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 initial writers = 56168.33 kB/sec 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 56170.24 kB/sec 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 56170.24 kB/sec 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 56170.24 kB/sec 2024-09-13T18:07:17.868 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:07:20.778 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:07:20.778 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T18:07:20.778 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:07:20.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:07:20.781 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:07:20.781 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:07:20.782 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:20.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 Processor -- start 2024-09-13T18:07:20.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 -- start start 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5d0159100 0x7ff5d00c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00c18f0 con 0x7ff5d014fdb0 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d0072070 con 0x7ff5d0071720 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d6b1e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d0159520 con 0x7ff5d0159100 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d5b1c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5d014fdb0 0x7ff5d0156530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59890/0 (socket says 172.21.15.88:59890) 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/4238531426 learned_addr learned my addr 172.21.15.88:0/4238531426 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/4238531426 >> v1:172.21.15.88:6789/0 conn(0x7ff5d014fdb0 legacy=0x7ff5d0156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:07:20.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/4238531426 >> v1:172.21.15.88:6789/0 conn(0x7ff5d014fdb0 legacy=0x7ff5d0156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d5b1c700 1 --1- 172.21.15.88:0/4238531426 >> v1:172.21.15.88:6789/0 conn(0x7ff5d014fdb0 0x7ff5d0156530 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d631d700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.94:3300/0 conn(0x7ff5d0159100 0x7ff5d00c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d631d700 1 -- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 msgr2=0x7ff5d0071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d631d700 1 -- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 msgr2=0x7ff5d0071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d631d700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:20.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d631d700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:20.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 -- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 msgr2=0x7ff5d0071b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:20.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:20.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 -- 172.21.15.88:0/4238531426 >> v1:172.21.15.88:6789/0 conn(0x7ff5d014fdb0 legacy=0x7ff5d0156530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 -- 172.21.15.88:0/4238531426 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d01560a0 con 0x7ff5d0159100 2024-09-13T18:07:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.890+0000 7ff5d531b700 1 --2- 172.21.15.88:0/4238531426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d0159100 0x7ff5d00c1c90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00723b0 tx=0x7ff5c0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc9c9dc8aa0efdd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d4b1a700 1 -- 172.21.15.88:0/4238531426 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0004230 con 0x7ff5d0159100 2024-09-13T18:07:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d4b1a700 1 -- 172.21.15.88:0/4238531426 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c0004390 con 0x7ff5d0159100 2024-09-13T18:07:20.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d4b1a700 1 -- 172.21.15.88:0/4238531426 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00036c0 con 0x7ff5d0159100 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/4238531426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d0159100 msgr2=0x7ff5d00c1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/4238531426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d0159100 0x7ff5d00c1c90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00723b0 tx=0x7ff5c0009b30 comp rx=0 tx=0).stop 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/4238531426 shutdown_connections 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/4238531426 >> v2:172.21.15.88:3300/0 conn(0x7ff5d0071720 0x7ff5d0071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/4238531426 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d0159100 0x7ff5d00c1c90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/4238531426 >> 172.21.15.88:0/4238531426 conn(0x7ff5d00ca720 msgr2=0x7ff5d00cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/4238531426 shutdown_connections 2024-09-13T18:07:20.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/4238531426 wait complete. 2024-09-13T18:07:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 Processor -- start 2024-09-13T18:07:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- start start 2024-09-13T18:07:20.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d014fdb0 0x7ff5d00c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 0x7ff5d01f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01537f0 con 0x7ff5d0071720 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0154650 con 0x7ff5d014fdb0 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d6b1e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d0153a40 con 0x7ff5d0159100 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d5b1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d5b1c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50330/0 (socket says 172.21.15.88:50330) 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.894+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/1474931464 learned_addr learned my addr 172.21.15.88:0/1474931464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 msgr2=0x7ff5d0156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 0x7ff5d01f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d5b1c700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 msgr2=0x7ff5d0156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d5b1c700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:20.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d5b1c700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d531b700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d014fdb0 0x7ff5d00c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d014fdb0 msgr2=0x7ff5d00c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d014fdb0 0x7ff5d00c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 msgr2=0x7ff5d0156cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 -- 172.21.15.88:0/1474931464 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00094b0 con 0x7ff5d0159100 2024-09-13T18:07:20.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d631d700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 0x7ff5d01f03e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400d5f0 tx=0x7ff5c400d900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40125f0 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c4012750 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d0153d20 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4012b00 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d01542e0 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d0155d30 con 0x7ff5d0159100 2024-09-13T18:07:20.906 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.898+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff5c4012c60 con 0x7ff5d0159100 2024-09-13T18:07:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.902+0000 7ff5ce7fc700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 0x7ff5bc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.902+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff5c4084020 con 0x7ff5d0159100 2024-09-13T18:07:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.902+0000 7ff5d5b1c700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 0x7ff5bc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:20.907 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.902+0000 7ff5d5b1c700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 0x7ff5bc068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8005370 tx=0x7ff5c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:20.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:20.910+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff5c4051310 con 0x7ff5d0159100 2024-09-13T18:07:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.142+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff5d0149ae0 con 0x7ff5d0159100 2024-09-13T18:07:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.142+0000 7ff5ce7fc700 1 -- 172.21.15.88:0/1474931464 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7ff5c4054930 con 0x7ff5d0159100 2024-09-13T18:07:21.150 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 msgr2=0x7ff5bc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 0x7ff5bc068bf0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8005370 tx=0x7ff5c8009040 comp rx=0 tx=0).stop 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 msgr2=0x7ff5d01f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 0x7ff5d01f03e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400d5f0 tx=0x7ff5c400d900 comp rx=0 tx=0).stop 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 shutdown_connections 2024-09-13T18:07:21.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff5bc066730 0x7ff5bc068bf0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5d0159100 0x7ff5d01f03e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5d014fdb0 0x7ff5d00c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 --2- 172.21.15.88:0/1474931464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5d0071720 0x7ff5d0156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 >> 172.21.15.88:0/1474931464 conn(0x7ff5d00ca720 msgr2=0x7ff5d014ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 shutdown_connections 2024-09-13T18:07:21.154 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.146+0000 7ff5d6b1e700 1 -- 172.21.15.88:0/1474931464 wait complete. 2024-09-13T18:07:21.168 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:07:21.168 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:07:21.169 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:07:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 Processor -- start 2024-09-13T18:07:21.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 -- start start 2024-09-13T18:07:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae0806d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0806c110 con 0x7fae080726e0 2024-09-13T18:07:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0806c3f0 con 0x7fae0806f110 2024-09-13T18:07:21.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae0c9e9700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0806d080 con 0x7fae0806f4f0 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae06d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fae080726e0 0x7fae0814f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59892/0 (socket says 172.21.15.88:59892) 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae06d9d700 1 -- 172.21.15.88:0/516815876 learned_addr learned my addr 172.21.15.88:0/516815876 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.274+0000 7fae05d9b700 1 --2- 172.21.15.88:0/516815876 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae0806d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0559a700 1 -- 172.21.15.88:0/516815876 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3938395161 0 0) 0x7fae0806c110 con 0x7fae080726e0 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0559a700 1 -- 172.21.15.88:0/516815876 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00035d0 con 0x7fae080726e0 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae05d9b700 1 -- 172.21.15.88:0/516815876 >> v1:172.21.15.94:6789/0 conn(0x7fae0806f110 legacy=0x7fae08155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae05d9b700 1 -- 172.21.15.88:0/516815876 >> v1:172.21.15.88:6789/0 conn(0x7fae080726e0 legacy=0x7fae0814f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae05d9b700 1 -- 172.21.15.88:0/516815876 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0806c6d0 con 0x7fae0806f4f0 2024-09-13T18:07:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae05d9b700 1 --2- 172.21.15.88:0/516815876 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae0806d4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5c00e2eb0c9a2be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0559a700 1 -- 172.21.15.88:0/516815876 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011830 con 0x7fae0806f4f0 2024-09-13T18:07:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0559a700 1 -- 172.21.15.88:0/516815876 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8011990 con 0x7fae0806f4f0 2024-09-13T18:07:21.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0559a700 1 -- 172.21.15.88:0/516815876 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011d20 con 0x7fae0806f4f0 2024-09-13T18:07:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 -- 172.21.15.88:0/516815876 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 msgr2=0x7fae0806d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/516815876 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae0806d4a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8009b90 comp rx=0 tx=0).stop 2024-09-13T18:07:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 -- 172.21.15.88:0/516815876 shutdown_connections 2024-09-13T18:07:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/516815876 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae0806d4a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 -- 172.21.15.88:0/516815876 >> 172.21.15.88:0/516815876 conn(0x7fae080ca790 msgr2=0x7fae080caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 -- 172.21.15.88:0/516815876 shutdown_connections 2024-09-13T18:07:21.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.278+0000 7fae0c9e9700 1 -- 172.21.15.88:0/516815876 wait complete. 2024-09-13T18:07:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 Processor -- start 2024-09-13T18:07:21.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 -- start start 2024-09-13T18:07:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae081ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 0x7fae080c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae081ec220 con 0x7fae080726e0 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08144e00 con 0x7fae0806f110 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0c9e9700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae081ef940 con 0x7fae0806f4f0 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae06d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 0x7fae080c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae05d9b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae081ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae06d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 0x7fae080c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50344/0 (socket says 172.21.15.88:50344) 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae05d9b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae081ebce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:45644/0 (socket says 172.21.15.88:45644) 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:43536/0 (socket says 172.21.15.88:43536) 2024-09-13T18:07:21.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae06d9d700 1 -- 172.21.15.88:0/4175642634 learned_addr learned my addr 172.21.15.88:0/4175642634 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 msgr2=0x7fae081ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae081ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 msgr2=0x7fae080c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 0x7fae080c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf80094b0 con 0x7fae0806f110 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae06d9d700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae080726e0 0x7fae080c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae05d9b700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae0806f4f0 0x7fae081ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fae0659c700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00c400 tx=0x7fadfc00c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.282+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0052d0 con 0x7fae0806f110 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc005450 con 0x7fae0806f110 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc006ac0 con 0x7fae0806f110 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08145050 con 0x7fae0806f110 2024-09-13T18:07:21.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae081ef5d0 con 0x7fae0806f110 2024-09-13T18:07:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 0x7fae08152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08067ae0 con 0x7fae08150340 2024-09-13T18:07:21.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae05d9b700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 0x7fae08152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae05d9b700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae0806c9b0 con 0x7fae08150340 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fae05d9b700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 0x7fae08152d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80045d0 con 0x7fae08150340 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fadf80038d0 con 0x7fae08150340 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 msgr2=0x7fae08152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 0x7fae08152d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fadf8009880 tx=0x7fadf8004770 comp rx=0 tx=0).stop 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 msgr2=0x7fae08152d20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae08150340 0x7fae08152d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.286+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fadfc0036a0 con 0x7fae0806f110 2024-09-13T18:07:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.290+0000 7fadf6ffd700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fade8066410 0x7fade80688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.290+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fadfc083200 con 0x7fae0806f110 2024-09-13T18:07:21.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.290+0000 7fae05d9b700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fade8066410 0x7fade80688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.290+0000 7fae05d9b700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fade8066410 0x7fade80688d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae08066f60 tx=0x7fadf8021000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 0x7fae0813f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae081efab0 con 0x7fae0813f140 2024-09-13T18:07:21.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae06d9d700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 0x7fae0813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae06d9d700 1 -- 172.21.15.88:0/4175642634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fae0813fa60 con 0x7fae0813f140 2024-09-13T18:07:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae06d9d700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 0x7fae0813f520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fae00001560 tx=0x7fae0000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.309 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0000dba0 con 0x7fae0813f140 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4451 (secure 0 0 0) 0x7fae0000dd00 con 0x7fae0813f140 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 msgr2=0x7fae0813f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 0x7fae0813f520 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fae00001560 tx=0x7fae0000d430 comp rx=0 tx=0).stop 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 msgr2=0x7fae0813f520 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fadf6ffd700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae0813f140 0x7fae0813f520 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.310 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:21.311 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:21.312 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.313 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:21.314 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.315 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.316 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.317 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.318 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.319 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.320 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.321 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.322 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.323 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:21.324 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fade8066410 msgr2=0x7fade80688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fade8066410 0x7fade80688d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fae08066f60 tx=0x7fadf8021000 comp rx=0 tx=0).stop 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae06d9d700 1 -- 172.21.15.88:0/4175642634 reap_dead start 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 msgr2=0x7fae081efdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fadfc00c400 tx=0x7fadfc00c710 comp rx=0 tx=0).stop 2024-09-13T18:07:21.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 shutdown_connections 2024-09-13T18:07:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 --2- 172.21.15.88:0/4175642634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae0806f110 0x7fae081efdd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 >> 172.21.15.88:0/4175642634 conn(0x7fae080ca790 msgr2=0x7fae0814e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 shutdown_connections 2024-09-13T18:07:21.326 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.302+0000 7fae0c9e9700 1 -- 172.21.15.88:0/4175642634 wait complete. 2024-09-13T18:07:21.329 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:21.329 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:07:21.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:07:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 Processor -- start 2024-09-13T18:07:21.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 -- start start 2024-09-13T18:07:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5da40c2680 0x7f5da415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da406cb00 con 0x7f5da406f110 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da406e9a0 con 0x7f5da40c2680 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5dab02b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da406cde0 con 0x7f5da406f4f0 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5da40c2680 0x7f5da415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5da40c2680 0x7f5da415d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50372/0 (socket says 172.21.15.88:50372) 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da95c8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da8dc7700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f5da406f110 0x7f5da406ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:32928/0 (socket says 172.21.15.88:32928) 2024-09-13T18:07:21.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 -- 172.21.15.88:0/1488839992 learned_addr learned my addr 172.21.15.88:0/1488839992 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 -- 172.21.15.88:0/1488839992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 msgr2=0x7f5da415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 --2- 172.21.15.88:0/1488839992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 -- 172.21.15.88:0/1488839992 >> v1:172.21.15.94:6789/0 conn(0x7f5da406f110 legacy=0x7f5da406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da37fe700 1 -- 172.21.15.88:0/1488839992 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032978443 0 0) 0x7f5da406cb00 con 0x7f5da406f110 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 -- 172.21.15.88:0/1488839992 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da406d0c0 con 0x7f5da40c2680 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.438+0000 7f5da3fff700 1 --2- 172.21.15.88:0/1488839992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da40c2680 0x7f5da415d9f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009940 tx=0x7f5d98009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb804ac3595b7b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5da37fe700 1 -- 172.21.15.88:0/1488839992 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011830 con 0x7f5da40c2680 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5da37fe700 1 -- 172.21.15.88:0/1488839992 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d98011990 con 0x7f5da40c2680 2024-09-13T18:07:21.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5da37fe700 1 -- 172.21.15.88:0/1488839992 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d98011d20 con 0x7f5da40c2680 2024-09-13T18:07:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 -- 172.21.15.88:0/1488839992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da40c2680 msgr2=0x7f5da415d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 --2- 172.21.15.88:0/1488839992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da40c2680 0x7f5da415d9f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009940 tx=0x7f5d98009c50 comp rx=0 tx=0).stop 2024-09-13T18:07:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 -- 172.21.15.88:0/1488839992 shutdown_connections 2024-09-13T18:07:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 --2- 172.21.15.88:0/1488839992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 --2- 172.21.15.88:0/1488839992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da40c2680 0x7f5da415d9f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 -- 172.21.15.88:0/1488839992 >> 172.21.15.88:0/1488839992 conn(0x7f5da406ffb0 msgr2=0x7f5da4070390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 -- 172.21.15.88:0/1488839992 shutdown_connections 2024-09-13T18:07:21.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.442+0000 7f5dab02b700 1 -- 172.21.15.88:0/1488839992 wait complete. 2024-09-13T18:07:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 Processor -- start 2024-09-13T18:07:21.451 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 -- start start 2024-09-13T18:07:21.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da40c7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40c2680 0x7f5da40c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da414dd80 con 0x7f5da406f110 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da414e040 con 0x7f5da40c2680 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5dab02b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da414e320 con 0x7f5da406f4f0 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50380/0 (socket says 172.21.15.88:50380) 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 -- 172.21.15.88:0/2879346180 learned_addr learned my addr 172.21.15.88:0/2879346180 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da40c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da95c8700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40c2680 0x7f5da40c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 msgr2=0x7f5da40c7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da40c7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40c2680 msgr2=0x7f5da40c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da40c2680 0x7f5da40c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98009570 con 0x7f5da406f110 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5da406f4f0 0x7f5da40c7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da8dc7700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c001f80 tx=0x7f5d9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c00acd0 con 0x7f5da406f110 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.446+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c00ae50 con 0x7f5da406f110 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da406b390 con 0x7f5da406f110 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c007310 con 0x7f5da406f110 2024-09-13T18:07:21.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da414e8e0 con 0x7f5da406f110 2024-09-13T18:07:21.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5dab02b700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 0x7f5da4142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da4068550 con 0x7f5da414ead0 2024-09-13T18:07:21.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 0x7f5da4142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da3fff700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5da406b210 con 0x7f5da414ead0 2024-09-13T18:07:21.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 0x7f5da4142860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da415afb0 tx=0x7f5d98004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9801f070 con 0x7f5da414ead0 2024-09-13T18:07:21.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.450+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d9c007470 con 0x7f5da406f110 2024-09-13T18:07:21.458 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d900667d0 0x7f5d90068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d9c084000 con 0x7f5da406f110 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da95c8700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d900667d0 0x7f5d90068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f5d980045b0 con 0x7f5da414ead0 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 msgr2=0x7f5da4142860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 0x7f5da4142860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5da415afb0 tx=0x7f5d98004770 comp rx=0 tx=0).stop 2024-09-13T18:07:21.459 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 msgr2=0x7f5da4142860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da17fa700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da414ead0 0x7f5da4142860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.454+0000 7f5da95c8700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d900667d0 0x7f5d90068c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5da406f900 tx=0x7f5d94009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 0x7f5da41f6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da415d4d0 con 0x7f5da4142da0 2024-09-13T18:07:21.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 0x7f5da41f6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da3fff700 1 -- 172.21.15.88:0/2879346180 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f5da414eeb0 con 0x7f5da4142da0 2024-09-13T18:07:21.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da3fff700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 0x7f5da41f6580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009910 tx=0x7f5d98011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9802bab0 con 0x7f5da4142da0 2024-09-13T18:07:21.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4947 (secure 0 0 0) 0x7f5d98035460 con 0x7f5da4142da0 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 msgr2=0x7f5da41f6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 0x7f5da41f6580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d98009910 tx=0x7f5d98011000 comp rx=0 tx=0).stop 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 msgr2=0x7f5da41f6580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da17fa700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5da4142da0 0x7f5da41f6580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:21.474 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:21.475 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.476 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.477 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:21.478 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.479 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.480 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.481 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.482 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.483 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.484 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.485 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.486 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.487 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.488 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:21.489 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:21.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d900667d0 msgr2=0x7f5d90068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d900667d0 0x7f5d90068c90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5da406f900 tx=0x7f5d94009240 comp rx=0 tx=0).stop 2024-09-13T18:07:21.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 msgr2=0x7f5da4144130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c001f80 tx=0x7f5d9c00a340 comp rx=0 tx=0).stop 2024-09-13T18:07:21.490 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5da95c8700 1 -- 172.21.15.88:0/2879346180 reap_dead start 2024-09-13T18:07:21.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 shutdown_connections 2024-09-13T18:07:21.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 --2- 172.21.15.88:0/2879346180 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5da406f110 0x7f5da4144130 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 >> 172.21.15.88:0/2879346180 conn(0x7f5da406ffb0 msgr2=0x7f5da4151310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 shutdown_connections 2024-09-13T18:07:21.491 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.466+0000 7f5dab02b700 1 -- 172.21.15.88:0/2879346180 wait complete. 2024-09-13T18:07:21.491 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:21.491 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:07:21.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:07:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 Processor -- start 2024-09-13T18:07:21.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 -- start start 2024-09-13T18:07:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe11c0ca700 0x7fe11c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe11c0caae0 0x7fe11c0c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c152f70 0x7fe11c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0cc480 con 0x7fe11c0caae0 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c15c800 con 0x7fe11c0ca700 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe1220c4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c15cae0 con 0x7fe11c152f70 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe11affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe11c0caae0 0x7fe11c0c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe11affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe11c0caae0 0x7fe11c0c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50396/0 (socket says 172.21.15.88:50396) 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe11affd700 1 -- 172.21.15.88:0/2299384403 learned_addr learned my addr 172.21.15.88:0/2299384403 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe11bfff700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c152f70 0x7fe11c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.606+0000 7fe11b7fe700 1 --2- 172.21.15.88:0/2299384403 >> v2:172.21.15.94:3300/0 conn(0x7fe11c0ca700 0x7fe11c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 -- 172.21.15.88:0/2299384403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c152f70 msgr2=0x7fe11c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c152f70 0x7fe11c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 -- 172.21.15.88:0/2299384403 >> v2:172.21.15.94:3300/0 conn(0x7fe11c0ca700 msgr2=0x7fe11c0cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 --2- 172.21.15.88:0/2299384403 >> v2:172.21.15.94:3300/0 conn(0x7fe11c0ca700 0x7fe11c0cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 -- 172.21.15.88:0/2299384403 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c15cdc0 con 0x7fe11c0caae0 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11affd700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c0caae0 0x7fe11c0c5610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0cfb60 tx=0x7fe10c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6874ea7785c8a06f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11a7fc700 1 -- 172.21.15.88:0/2299384403 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c011830 con 0x7fe11c0caae0 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11a7fc700 1 -- 172.21.15.88:0/2299384403 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c011990 con 0x7fe11c0caae0 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11a7fc700 1 -- 172.21.15.88:0/2299384403 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c011d20 con 0x7fe11c0caae0 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- 172.21.15.88:0/2299384403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c0caae0 msgr2=0x7fe11c0c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c0caae0 0x7fe11c0c5610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe11c0cfb60 tx=0x7fe10c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- 172.21.15.88:0/2299384403 shutdown_connections 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c152f70 0x7fe11c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- 172.21.15.88:0/2299384403 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c0caae0 0x7fe11c0c5610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- 172.21.15.88:0/2299384403 >> v2:172.21.15.94:3300/0 conn(0x7fe11c0ca700 0x7fe11c0cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- 172.21.15.88:0/2299384403 >> 172.21.15.88:0/2299384403 conn(0x7fe11c0cf130 msgr2=0x7fe11c0cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- 172.21.15.88:0/2299384403 shutdown_connections 2024-09-13T18:07:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- 172.21.15.88:0/2299384403 wait complete. 2024-09-13T18:07:21.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 Processor -- start 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- start start 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c0ca700 0x7fe11c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe11c0caae0 0x7fe11c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 0x7fe11c15a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1e4c10 con 0x7fe11c152f70 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c1ef8a0 con 0x7fe11c0caae0 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe1220c4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c153380 con 0x7fe11c0ca700 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 0x7fe11c15a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 0x7fe11c15a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50410/0 (socket says 172.21.15.88:50410) 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11bfff700 1 -- 172.21.15.88:0/885263976 learned_addr learned my addr 172.21.15.88:0/885263976 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.610+0000 7fe11b7fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c0ca700 0x7fe11c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe11c0caae0 0x7fe11c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c0ca700 msgr2=0x7fe11c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c0ca700 0x7fe11c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 msgr2=0x7fe11c15a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 0x7fe11c15a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009570 con 0x7fe11c0caae0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11bfff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe11c152f70 0x7fe11c15a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11affd700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe11c0caae0 0x7fe11c155790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe10c016000 tx=0x7fe10c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004240 con 0x7fe11c0caae0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c01f070 con 0x7fe11c0caae0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c153660 con 0x7fe11c0caae0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c004600 con 0x7fe11c0caae0 2024-09-13T18:07:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c0b4850 con 0x7fe11c0caae0 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe1220c4700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 0x7fe11c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c06ea60 con 0x7fe11c154970 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11b7fe700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 0x7fe11c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe10c021030 con 0x7fe11c0caae0 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.614+0000 7fe11b7fe700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe11c0c5b50 con 0x7fe11c154970 2024-09-13T18:07:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe11b7fe700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 0x7fe11c15a770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1040119d0 tx=0x7fe104011d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0fc066760 0x7fe0fc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe10c085280 con 0x7fe11c0caae0 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe11bfff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0fc066760 0x7fe0fc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104004240 con 0x7fe11c154970 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fe1040043a0 con 0x7fe11c154970 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 msgr2=0x7fe11c15a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 0x7fe11c15a770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe1040119d0 tx=0x7fe104011d90 comp rx=0 tx=0).stop 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 msgr2=0x7fe11c15a770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe113fff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c154970 0x7fe11c15a770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.618+0000 7fe11bfff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0fc066760 0x7fe0fc068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1140094c0 tx=0x7fe11400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.630+0000 7fe1220c4700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 0x7fe11c14c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.630+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c15d380 con 0x7fe11c153850 2024-09-13T18:07:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.630+0000 7fe11b7fe700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 0x7fe11c14c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.630+0000 7fe11b7fe700 1 -- 172.21.15.88:0/885263976 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fe11c06fe40 con 0x7fe11c153850 2024-09-13T18:07:21.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.630+0000 7fe11b7fe700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 0x7fe11c14c3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe104009210 tx=0x7fe104004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10401e450 con 0x7fe11c153850 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7fe1040283a0 con 0x7fe11c153850 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 msgr2=0x7fe11c14c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 0x7fe11c14c3c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe104009210 tx=0x7fe104004770 comp rx=0 tx=0).stop 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 msgr2=0x7fe11c14c3c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:21.640 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.641 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:21.643 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:21.644 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:21.645 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.648 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.649 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.650 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:21.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:07:21.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:21.653 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:21.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:21.653 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:21.653 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:21.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe113fff700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe11c153850 0x7fe11c14c3c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0fc066760 msgr2=0x7fe0fc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0fc066760 0x7fe0fc068c20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1140094c0 tx=0x7fe11400b040 comp rx=0 tx=0).stop 2024-09-13T18:07:21.654 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe11c0caae0 msgr2=0x7fe11c155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 --2- 172.21.15.88:0/885263976 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe11c0caae0 0x7fe11c155790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe10c016000 tx=0x7fe10c004770 comp rx=0 tx=0).stop 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe11bfff700 1 -- 172.21.15.88:0/885263976 reap_dead start 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe11bfff700 1 -- 172.21.15.88:0/885263976 reap_dead start 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 shutdown_connections 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 >> 172.21.15.88:0/885263976 conn(0x7fe11c0cf130 msgr2=0x7fe11c070220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 shutdown_connections 2024-09-13T18:07:21.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.634+0000 7fe1220c4700 1 -- 172.21.15.88:0/885263976 wait complete. 2024-09-13T18:07:21.655 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:21.655 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T18:07:21.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T18:07:21.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.766+0000 7f1a41463700 1 Processor -- start 2024-09-13T18:07:21.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- start start 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a3c150ef0 0x7f1a3c0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c2680 0x7f1a3c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3c06eea0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c64c0 con 0x7f1a3c150ef0 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c6f00 con 0x7f1a3c0c2680 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a3c150ef0 0x7f1a3c0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a40c62700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a3c1571f0 0x7f1a3c0c8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59900/0 (socket says 172.21.15.88:59900) 2024-09-13T18:07:21.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a40c62700 1 -- 172.21.15.88:0/1478424778 learned_addr learned my addr 172.21.15.88:0/1478424778 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a337fe700 1 --2- 172.21.15.88:0/1478424778 >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c2680 0x7f1a3c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1478424778 >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c2680 msgr2=0x7f1a3c156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/1478424778 >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c2680 0x7f1a3c156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1478424778 >> v1:172.21.15.88:6789/0 conn(0x7f1a3c1571f0 legacy=0x7f1a3c0c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 -- 172.21.15.88:0/1478424778 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c06f0d0 con 0x7f1a3c150ef0 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/1478424778 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442966007 0 0) 0x7f1a3c06eea0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/1478424778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c150ef0 0x7f1a3c0cae00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c06a3b0 tx=0x7f1a2c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c63f70c5c63a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/1478424778 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c011830 con 0x7f1a3c150ef0 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/1478424778 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c011990 con 0x7f1a3c150ef0 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a3b7fe700 1 -- 172.21.15.88:0/1478424778 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c011d40 con 0x7f1a3c150ef0 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- 172.21.15.88:0/1478424778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c150ef0 msgr2=0x7f1a3c0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 --2- 172.21.15.88:0/1478424778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c150ef0 0x7f1a3c0cae00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c06a3b0 tx=0x7f1a2c009b30 comp rx=0 tx=0).stop 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- 172.21.15.88:0/1478424778 shutdown_connections 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 --2- 172.21.15.88:0/1478424778 >> v2:172.21.15.94:3300/0 conn(0x7f1a3c0c2680 0x7f1a3c156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 --2- 172.21.15.88:0/1478424778 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c150ef0 0x7f1a3c0cae00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- 172.21.15.88:0/1478424778 >> 172.21.15.88:0/1478424778 conn(0x7f1a3c06a820 msgr2=0x7f1a3c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- 172.21.15.88:0/1478424778 shutdown_connections 2024-09-13T18:07:21.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.770+0000 7f1a41463700 1 -- 172.21.15.88:0/1478424778 wait complete. 2024-09-13T18:07:21.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.774+0000 7f1a41463700 1 Processor -- start 2024-09-13T18:07:21.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.774+0000 7f1a41463700 1 -- start start 2024-09-13T18:07:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.774+0000 7f1a41463700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c2680 0x7f1a3c1ef040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1efa30 con 0x7f1a3c1571f0 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c0c7a60 con 0x7f1a3c0c2680 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1e37d0 con 0x7f1a3c150ef0 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50424/0 (socket says 172.21.15.88:50424) 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 -- 172.21.15.88:0/2599743339 learned_addr learned my addr 172.21.15.88:0/2599743339 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c2680 0x7f1a3c1ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a337fe700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 -- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 msgr2=0x7f1a3c0c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c0c4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 -- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c2680 msgr2=0x7f1a3c1ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c2680 0x7f1a3c1ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 -- 172.21.15.88:0/2599743339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0094b0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a40c62700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a34002230 tx=0x7f1a3400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3400aac0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3400ac40 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c1e3ab0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a340070d0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c1efc80 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c1e3fd0 con 0x7f1a3c1571f0 2024-09-13T18:07:21.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.778+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1a34007250 con 0x7f1a3c1571f0 2024-09-13T18:07:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.782+0000 7f1a397fa700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 0x7f1a1c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.782+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a34084010 con 0x7f1a3c1571f0 2024-09-13T18:07:21.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.782+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 0x7f1a1c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:21.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.782+0000 7f1a3bfff700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 0x7f1a1c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0090b0 tx=0x7f1a2c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:21.796 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:21.790+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f1a3c1e3fd0 con 0x7f1a3c1571f0 2024-09-13T18:07:22.026 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.018+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7f1a3c1e3fd0 con 0x7f1a3c1571f0 2024-09-13T18:07:22.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a397fa700 1 -- 172.21.15.88:0/2599743339 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7f1a3c1e3fd0 con 0x7f1a3c1571f0 2024-09-13T18:07:22.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 msgr2=0x7f1a1c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 0x7f1a1c068bf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0090b0 tx=0x7f1a2c008030 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 msgr2=0x7f1a3c1f0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1a34002230 tx=0x7f1a3400cf50 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 shutdown_connections 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1a1c066730 0x7f1a1c068bf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a3c150ef0 0x7f1a3c0c4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a3c1571f0 0x7f1a3c1f0480 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 --2- 172.21.15.88:0/2599743339 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a3c0c2680 0x7f1a3c1ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 >> 172.21.15.88:0/2599743339 conn(0x7f1a3c06a820 msgr2=0x7f1a3c0c95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.022+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 shutdown_connections 2024-09-13T18:07:22.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:22.026+0000 7f1a41463700 1 -- 172.21.15.88:0/2599743339 wait complete. 2024-09-13T18:07:22.044 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-13T18:07:32.045 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:07:32.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:32.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 Processor -- start 2024-09-13T18:07:32.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 -- start start 2024-09-13T18:07:32.158 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c151370 0x7fbb9c0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0c5940 0x7fbb9c070380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c06f040 con 0x7fbb9c150f90 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c0708c0 con 0x7fbb9c0c5940 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06f2e0 con 0x7fbb9c151370 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb9c150f90 0x7fbb9c06c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60974/0 (socket says 172.21.15.88:60974) 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9affd700 1 -- 172.21.15.88:0/3660949593 learned_addr learned my addr 172.21.15.88:0/3660949593 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3660949593 >> v2:172.21.15.88:3300/0 conn(0x7fbb9c0c5940 0x7fbb9c070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.153+0000 7fbb9a7fc700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c151370 0x7fbb9c0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3660949593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c151370 msgr2=0x7fbb9c0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c151370 0x7fbb9c0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3660949593 >> v1:172.21.15.88:6789/0 conn(0x7fbb9c150f90 legacy=0x7fbb9c06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.159 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/3660949593 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c06f5c0 con 0x7fbb9c0c5940 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5940 0x7fbb9c070380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009d90 tx=0x7fbb9400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ba3587b9386d5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb99ffb700 1 -- 172.21.15.88:0/3660949593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9400e070 con 0x7fbb9c0c5940 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb99ffb700 1 -- 172.21.15.88:0/3660949593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9400bbd0 con 0x7fbb9c0c5940 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb99ffb700 1 -- 172.21.15.88:0/3660949593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94012430 con 0x7fbb9c0c5940 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3660949593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5940 msgr2=0x7fbb9c070380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5940 0x7fbb9c070380 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbb94009d90 tx=0x7fbb9400b330 comp rx=0 tx=0).stop 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3660949593 shutdown_connections 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5940 0x7fbb9c070380 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/3660949593 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c151370 0x7fbb9c0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3660949593 >> 172.21.15.88:0/3660949593 conn(0x7fbb9c0c7a40 msgr2=0x7fbb9c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3660949593 shutdown_connections 2024-09-13T18:07:32.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- 172.21.15.88:0/3660949593 wait complete. 2024-09-13T18:07:32.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 Processor -- start 2024-09-13T18:07:32.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.157+0000 7fbb9bfff700 1 -- start start 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c0c5940 0x7fbb9c0c1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 0x7fbb9c0c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1eeb80 con 0x7fbb9c0c5070 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c1ea6c0 con 0x7fbb9c150f90 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c157f40 con 0x7fbb9c0c5940 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39838/0 (socket says 172.21.15.88:39838) 2024-09-13T18:07:32.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/2678621032 learned_addr learned my addr 172.21.15.88:0/2678621032 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9affd700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c0c5940 0x7fbb9c0c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9a7fc700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 0x7fbb9c0c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c0c5940 msgr2=0x7fbb9c0c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c0c5940 0x7fbb9c0c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 msgr2=0x7fbb9c0c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 0x7fbb9c0c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 -- 172.21.15.88:0/2678621032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94009a70 con 0x7fbb9c0c5070 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9a7fc700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 0x7fbb9c0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:07:32.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9b7fe700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400b370 tx=0x7fbb94004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94012e50 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb94020070 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c1edd40 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94004280 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c1ee2e0 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.161+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c1ea830 con 0x7fbb9c0c5070 2024-09-13T18:07:32.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.165+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbb940043e0 con 0x7fbb9c0c5070 2024-09-13T18:07:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.165+0000 7fbb837fe700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 0x7fbb88068c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.165+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbb94022070 con 0x7fbb9c0c5070 2024-09-13T18:07:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.165+0000 7fbb9affd700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 0x7fbb88068c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.165+0000 7fbb9affd700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 0x7fbb88068c70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005930 tx=0x7fbb8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.169+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fbb94053830 con 0x7fbb9c0c5070 2024-09-13T18:07:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.453+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fbb9c1ea830 con 0x7fbb9c0c5070 2024-09-13T18:07:32.457 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.453+0000 7fbb837fe700 1 -- 172.21.15.88:0/2678621032 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fbb9c1ea830 con 0x7fbb9c0c5070 2024-09-13T18:07:32.458 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 msgr2=0x7fbb88068c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 0x7fbb88068c70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c005930 tx=0x7fbb8c009040 comp rx=0 tx=0).stop 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 msgr2=0x7fbb9c1eab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbb9400b370 tx=0x7fbb94004af0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 shutdown_connections 2024-09-13T18:07:32.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbb880667b0 0x7fbb88068c70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb9c0c5070 0x7fbb9c1eab10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbb9c150f90 0x7fbb9c0c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 --2- 172.21.15.88:0/2678621032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbb9c0c5940 0x7fbb9c0c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 >> 172.21.15.88:0/2678621032 conn(0x7fbb9c0c7a40 msgr2=0x7fbb9c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 shutdown_connections 2024-09-13T18:07:32.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.457+0000 7fbb9bfff700 1 -- 172.21.15.88:0/2678621032 wait complete. 2024-09-13T18:07:32.475 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:07:32.475 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T18:07:32.475 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:07:32.476 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:07:32.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 Processor -- start 2024-09-13T18:07:32.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 -- start start 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf28051a10 0x7faf2804d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf28045d00 0x7faf28008b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf2804d540 con 0x7faf28051a10 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf28007830 con 0x7faf28045d00 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf28007a80 con 0x7faf2804cc20 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf28051a10 0x7faf2804d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf28051a10 0x7faf2804d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39840/0 (socket says 172.21.15.88:39840) 2024-09-13T18:07:32.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 -- 172.21.15.88:0/2297059485 learned_addr learned my addr 172.21.15.88:0/2297059485 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:32.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2f7fe700 1 --2- 172.21.15.88:0/2297059485 >> v2:172.21.15.94:3300/0 conn(0x7faf28045d00 0x7faf28008b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2effd700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 -- 172.21.15.88:0/2297059485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 msgr2=0x7faf280dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 -- 172.21.15.88:0/2297059485 >> v2:172.21.15.94:3300/0 conn(0x7faf28045d00 msgr2=0x7faf28008b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/2297059485 >> v2:172.21.15.94:3300/0 conn(0x7faf28045d00 0x7faf28008b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 -- 172.21.15.88:0/2297059485 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28007d60 con 0x7faf28051a10 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf2804d000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf2800eb20 tx=0x7faf24009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717e24abdb3c5a61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2dffb700 1 -- 172.21.15.88:0/2297059485 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24011830 con 0x7faf28051a10 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2dffb700 1 -- 172.21.15.88:0/2297059485 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24011990 con 0x7faf28051a10 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.585+0000 7faf2dffb700 1 -- 172.21.15.88:0/2297059485 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24011d20 con 0x7faf28051a10 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- 172.21.15.88:0/2297059485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 msgr2=0x7faf2804d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf2804d000 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf2800eb20 tx=0x7faf24009bf0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- 172.21.15.88:0/2297059485 shutdown_connections 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- 172.21.15.88:0/2297059485 >> v2:172.21.15.94:3300/0 conn(0x7faf28045d00 0x7faf28008b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf2804d000 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- 172.21.15.88:0/2297059485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- 172.21.15.88:0/2297059485 >> 172.21.15.88:0/2297059485 conn(0x7faf28050e60 msgr2=0x7faf28051270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- 172.21.15.88:0/2297059485 shutdown_connections 2024-09-13T18:07:32.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- 172.21.15.88:0/2297059485 wait complete. 2024-09-13T18:07:32.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 Processor -- start 2024-09-13T18:07:32.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- start start 2024-09-13T18:07:32.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf28045d00 0x7faf281711d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2804aa30 con 0x7faf28051a10 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280dd420 con 0x7faf28045d00 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280dc4e0 con 0x7faf2804cc20 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39844/0 (socket says 172.21.15.88:39844) 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2f7fe700 1 -- 172.21.15.88:0/3620888470 learned_addr learned my addr 172.21.15.88:0/3620888470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.589+0000 7faf2effd700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf28045d00 0x7faf281711d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 msgr2=0x7faf280dd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf2804cc20 0x7faf280dd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf28045d00 msgr2=0x7faf281711d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf28045d00 0x7faf281711d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf24009570 con 0x7faf28051a10 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2f7fe700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faf30073020 tx=0x7faf30074690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30068610 con 0x7faf28051a10 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30067ae0 con 0x7faf28051a10 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf280dc7a0 con 0x7faf28051a10 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30067e90 con 0x7faf28051a10 2024-09-13T18:07:32.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf280dcd60 con 0x7faf28051a10 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2ffff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 0x7faf280d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280095f0 con 0x7faf2804c530 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2effd700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 0x7faf280d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2effd700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf2804d6b0 con 0x7faf2804c530 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7faf300720c0 con 0x7faf28051a10 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf2effd700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 0x7faf280d3bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf200119b0 tx=0x7faf20011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faf1c066760 0x7faf1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faf300fe740 con 0x7faf28051a10 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf20004240 con 0x7faf2804c530 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7faf200043a0 con 0x7faf2804c530 2024-09-13T18:07:32.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 msgr2=0x7faf280d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 0x7faf280d3bd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7faf200119b0 tx=0x7faf20011d70 comp rx=0 tx=0).stop 2024-09-13T18:07:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 msgr2=0x7faf280d3bd0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.593+0000 7faf17fff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf2804c530 0x7faf280d3bd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.597+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faf1c066760 0x7faf1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.600 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.597+0000 7faf2e7fc700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faf1c066760 0x7faf1c068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf2800eb20 tx=0x7faf24008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.605+0000 7faf2ffff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 0x7faf280debd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.605+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf280db1c0 con 0x7faf280de7c0 2024-09-13T18:07:32.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.605+0000 7faf2effd700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 0x7faf280debd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2effd700 1 -- 172.21.15.88:0/3620888470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7faf28008600 con 0x7faf280de7c0 2024-09-13T18:07:32.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2effd700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 0x7faf280debd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faf20012010 tx=0x7faf20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000fe00 con 0x7faf280de7c0 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4452 (secure 0 0 0) 0x7faf200283a0 con 0x7faf280de7c0 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 msgr2=0x7faf280debd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 0x7faf280debd0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faf20012010 tx=0x7faf20004770 comp rx=0 tx=0).stop 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 msgr2=0x7faf280debd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf17fff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf280de7c0 0x7faf280debd0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:32.612 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:32.613 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.614 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:32.615 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.616 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.617 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.618 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:32.619 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.620 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.621 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.622 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.623 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:32.624 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faf1c066760 msgr2=0x7faf1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7faf1c066760 0x7faf1c068c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7faf2800eb20 tx=0x7faf24008030 comp rx=0 tx=0).stop 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2f7fe700 1 -- 172.21.15.88:0/3620888470 reap_dead start 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 msgr2=0x7faf280d3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7faf30073020 tx=0x7faf30074690 comp rx=0 tx=0).stop 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 shutdown_connections 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 --2- 172.21.15.88:0/3620888470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28051a10 0x7faf280d3690 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 >> 172.21.15.88:0/3620888470 conn(0x7faf28050e60 msgr2=0x7faf28034f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 shutdown_connections 2024-09-13T18:07:32.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.609+0000 7faf2ffff700 1 -- 172.21.15.88:0/3620888470 wait complete. 2024-09-13T18:07:32.627 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:32.627 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:07:32.627 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:07:32.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.733+0000 7fb836e26700 1 Processor -- start 2024-09-13T18:07:32.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.733+0000 7fb836e26700 1 -- start start 2024-09-13T18:07:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8300c7420 0x7fb8300c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8300c64a0 con 0x7fb8300c7800 2024-09-13T18:07:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8300c41a0 con 0x7fb8300c3cb0 2024-09-13T18:07:32.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8300c4480 con 0x7fb8300c7420 2024-09-13T18:07:32.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835e24700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb8300c7420 0x7fb8300c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835623700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb8300c7800 0x7fb8300c9240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60976/0 (socket says 172.21.15.88:60976) 2024-09-13T18:07:32.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835623700 1 -- 172.21.15.88:0/3092144861 learned_addr learned my addr 172.21.15.88:0/3092144861 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:32.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835e24700 1 -- 172.21.15.88:0/3092144861 >> v1:172.21.15.94:6789/0 conn(0x7fb8300c3cb0 legacy=0x7fb830150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835e24700 1 -- 172.21.15.88:0/3092144861 >> v1:172.21.15.88:6789/0 conn(0x7fb8300c7800 legacy=0x7fb8300c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb834e22700 1 -- 172.21.15.88:0/3092144861 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449835416 0 0) 0x7fb8300c64a0 con 0x7fb8300c7800 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835e24700 1 -- 172.21.15.88:0/3092144861 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300c4760 con 0x7fb8300c7420 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb835e24700 1 --2- 172.21.15.88:0/3092144861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c7420 0x7fb8300c6930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb820009850 tx=0x7fb820009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96b5d2369b5d854 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb834e22700 1 -- 172.21.15.88:0/3092144861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011830 con 0x7fb8300c7420 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb834e22700 1 -- 172.21.15.88:0/3092144861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820011990 con 0x7fb8300c7420 2024-09-13T18:07:32.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb834e22700 1 -- 172.21.15.88:0/3092144861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820011d20 con 0x7fb8300c7420 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- 172.21.15.88:0/3092144861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c7420 msgr2=0x7fb8300c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 --2- 172.21.15.88:0/3092144861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c7420 0x7fb8300c6930 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb820009850 tx=0x7fb820009b60 comp rx=0 tx=0).stop 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- 172.21.15.88:0/3092144861 shutdown_connections 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 --2- 172.21.15.88:0/3092144861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c7420 0x7fb8300c6930 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- 172.21.15.88:0/3092144861 >> 172.21.15.88:0/3092144861 conn(0x7fb830066090 msgr2=0x7fb8300664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- 172.21.15.88:0/3092144861 shutdown_connections 2024-09-13T18:07:32.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- 172.21.15.88:0/3092144861 wait complete. 2024-09-13T18:07:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 Processor -- start 2024-09-13T18:07:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.737+0000 7fb836e26700 1 -- start start 2024-09-13T18:07:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8300c7420 0x7fb8301eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300c7800 0x7fb8301ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830153000 con 0x7fb8300c3cb0 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8301524f0 con 0x7fb8300c7800 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8300cbb40 con 0x7fb8300c7420 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39872/0 (socket says 172.21.15.88:39872) 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 -- 172.21.15.88:0/3349368625 learned_addr learned my addr 172.21.15.88:0/3349368625 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835623700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8300c7420 0x7fb8301eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836625700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300c7800 0x7fb8301ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8300c7420 msgr2=0x7fb8301eecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb8300c7420 0x7fb8301eecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300c7800 msgr2=0x7fb8301ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300c7800 0x7fb8301ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8200094b0 con 0x7fb8300c3cb0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835e24700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8200090b0 tx=0x7fb820004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82000bbd0 con 0x7fb8300c3cb0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82001f070 con 0x7fb8300c3cb0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb830154090 con 0x7fb8300c3cb0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82001a430 con 0x7fb8300c3cb0 2024-09-13T18:07:32.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8301537a0 con 0x7fb8300c3cb0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 0x7fb8300c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830068200 con 0x7fb8301434a0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835623700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 0x7fb8300c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835623700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb830151040 con 0x7fb8301434a0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb835623700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 0x7fb8300c9690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8301ec8f0 tx=0x7fb82c001680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.741+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb82001a590 con 0x7fb8300c3cb0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb814066760 0x7fb814068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb820021070 con 0x7fb8300c3cb0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c001d00 con 0x7fb8301434a0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fb82c0114f0 con 0x7fb8301434a0 2024-09-13T18:07:32.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 msgr2=0x7fb8300c9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 0x7fb8300c9690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8301ec8f0 tx=0x7fb82c001680 comp rx=0 tx=0).stop 2024-09-13T18:07:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 msgr2=0x7fb8300c9690 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb8267fc700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8301434a0 0x7fb8300c9690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb836625700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb814066760 0x7fb814068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.745+0000 7fb836625700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb814066760 0x7fb814068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8280012e0 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb836e26700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 0x7fb830153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830153e70 con 0x7fb8300cb4a0 2024-09-13T18:07:32.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb835623700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 0x7fb830153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb835623700 1 -- 172.21.15.88:0/3349368625 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fb8300c6930 con 0x7fb8300cb4a0 2024-09-13T18:07:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb835623700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 0x7fb830153930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007c60 tx=0x7fb82c000ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c01cae0 con 0x7fb8300cb4a0 2024-09-13T18:07:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4948 (secure 0 0 0) 0x7fb82c01cc40 con 0x7fb8300cb4a0 2024-09-13T18:07:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 msgr2=0x7fb830153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 0x7fb830153930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb82c007c60 tx=0x7fb82c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 msgr2=0x7fb830153930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb8267fc700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8300cb4a0 0x7fb830153930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.759 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.760 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.761 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:32.762 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.763 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.765 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:32.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.769 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:07:32.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:32.772 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb814066760 msgr2=0x7fb814068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.753+0000 7fb836e26700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb814066760 0x7fb814068c20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb8280012e0 tx=0x7fb828009040 comp rx=0 tx=0).stop 2024-09-13T18:07:32.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 msgr2=0x7fb830142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb8200090b0 tx=0x7fb820004770 comp rx=0 tx=0).stop 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836625700 1 -- 172.21.15.88:0/3349368625 reap_dead start 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 shutdown_connections 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 --2- 172.21.15.88:0/3349368625 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8300c3cb0 0x7fb830142b00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 >> 172.21.15.88:0/3349368625 conn(0x7fb830066090 msgr2=0x7fb83014e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 shutdown_connections 2024-09-13T18:07:32.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.757+0000 7fb836e26700 1 -- 172.21.15.88:0/3349368625 wait complete. 2024-09-13T18:07:32.774 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:32.774 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:07:32.775 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:07:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.881+0000 7ff18d7fe700 1 Processor -- start 2024-09-13T18:07:32.887 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- start start 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff1880cbfd0 0x7ff18806c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1880c6e80 con 0x7ff1880cc3b0 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18815c9f0 con 0x7ff188158f70 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18815c490 con 0x7ff1880cbfd0 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff187fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff1880cbfd0 0x7ff18806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff1877fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff1880cc3b0 0x7ff18815ce80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60986/0 (socket says 172.21.15.88:60986) 2024-09-13T18:07:32.888 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff1877fe700 1 -- 172.21.15.88:0/1917189428 learned_addr learned my addr 172.21.15.88:0/1917189428 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:32.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644660832 0 0) 0x7ff18815c9f0 con 0x7ff188158f70 2024-09-13T18:07:32.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1700035d0 con 0x7ff188158f70 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136298050 0 0) 0x7ff17c001110 con 0x7ff1880cc3b0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff18815c9f0 con 0x7ff1880cc3b0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff187fff700 1 -- 172.21.15.88:0/1917189428 >> v1:172.21.15.94:6789/0 conn(0x7ff188158f70 legacy=0x7ff188152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff187fff700 1 -- 172.21.15.88:0/1917189428 >> v1:172.21.15.88:6789/0 conn(0x7ff1880cc3b0 legacy=0x7ff18815ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff187fff700 1 -- 172.21.15.88:0/1917189428 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880c6340 con 0x7ff1880cbfd0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff187fff700 1 --2- 172.21.15.88:0/1917189428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cbfd0 0x7ff18806c830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff178009850 tx=0x7ff178009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6d7c37de3847a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178011830 con 0x7ff1880cbfd0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff178011990 con 0x7ff1880cbfd0 2024-09-13T18:07:32.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff186ffd700 1 -- 172.21.15.88:0/1917189428 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178011d40 con 0x7ff1880cbfd0 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1917189428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cbfd0 msgr2=0x7ff18806c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1917189428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cbfd0 0x7ff18806c830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff178009850 tx=0x7ff178009b60 comp rx=0 tx=0).stop 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1917189428 shutdown_connections 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1917189428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cbfd0 0x7ff18806c830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1917189428 >> 172.21.15.88:0/1917189428 conn(0x7ff188066270 msgr2=0x7ff188066650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1917189428 shutdown_connections 2024-09-13T18:07:32.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.885+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1917189428 wait complete. 2024-09-13T18:07:32.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 Processor -- start 2024-09-13T18:07:32.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 -- start start 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1880cbfd0 0x7ff1880c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cc3b0 0x7ff1880c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff188158f70 0x7ff1881e2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881e1b90 con 0x7ff1880cbfd0 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881e1e70 con 0x7ff1880cc3b0 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18d7fe700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1881e3470 con 0x7ff188158f70 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff187fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1880cbfd0 0x7ff1880c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff187fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1880cbfd0 0x7ff1880c3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39880/0 (socket says 172.21.15.88:39880) 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff187fff700 1 -- 172.21.15.88:0/1877710195 learned_addr learned my addr 172.21.15.88:0/1877710195 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff1877fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cc3b0 0x7ff1880c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.889+0000 7ff18cffd700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff188158f70 0x7ff1881e2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff188158f70 msgr2=0x7ff1881e2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff188158f70 0x7ff1881e2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1880cbfd0 msgr2=0x7ff1880c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff1880cbfd0 0x7ff1880c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1780094b0 con 0x7ff1880cc3b0 2024-09-13T18:07:32.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff1877fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cc3b0 0x7ff1880c4180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c700 tx=0x7ff17c00ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c005d90 con 0x7ff1880cc3b0 2024-09-13T18:07:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0070d0 con 0x7ff1880cc3b0 2024-09-13T18:07:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1881ef060 con 0x7ff1880cc3b0 2024-09-13T18:07:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c007460 con 0x7ff1880cc3b0 2024-09-13T18:07:32.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1881ef300 con 0x7ff1880cc3b0 2024-09-13T18:07:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff17c0075c0 con 0x7ff1880cc3b0 2024-09-13T18:07:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 0x7ff1881e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188068400 con 0x7ff18814dce0 2024-09-13T18:07:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.893+0000 7ff187fff700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 0x7ff1881e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff174066730 0x7ff174068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff17c083350 con 0x7ff1880cc3b0 2024-09-13T18:07:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff18cffd700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff174066730 0x7ff174068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff187fff700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1880c6ba0 con 0x7ff18814dce0 2024-09-13T18:07:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff187fff700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 0x7ff1881e2840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff178000c00 tx=0x7ff178004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff178020070 con 0x7ff18814dce0 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff18cffd700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff174066730 0x7ff174068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff180001560 tx=0x7ff180009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff17801b7d0 con 0x7ff18814dce0 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 msgr2=0x7ff1881e2840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 0x7ff1881e2840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff178000c00 tx=0x7ff178004770 comp rx=0 tx=0).stop 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 msgr2=0x7ff1881e2840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.897+0000 7ff184ff9700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff18814dce0 0x7ff1881e2840 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff178000c00 tx=0x7ff178004770 comp rx=0 tx=0).stop 2024-09-13T18:07:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 0x7ff1881f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880c68c0 con 0x7ff1881e3ba0 2024-09-13T18:07:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff187fff700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 0x7ff1881f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:32.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff187fff700 1 -- 172.21.15.88:0/1877710195 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff18815c680 con 0x7ff1881e3ba0 2024-09-13T18:07:32.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff187fff700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 0x7ff1881f1ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff178009ba0 tx=0x7ff178011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:32.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.905+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17802db80 con 0x7ff1881e3ba0 2024-09-13T18:07:32.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4782 (secure 0 0 0) 0x7ff178031070 con 0x7ff1881e3ba0 2024-09-13T18:07:32.911 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 msgr2=0x7ff1881f1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.911 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:32.911 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 22, 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.912 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.913 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.914 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:32.915 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:32.916 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.917 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.918 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:32.919 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:32.920 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.921 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.922 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.923 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:07:32.924 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:32.925 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:32.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:32.925 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:32.925 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff184ff9700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 0x7ff1881f1ab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff178009ba0 tx=0x7ff178011000 comp rx=0 tx=0).stop 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff184ff9700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 msgr2=0x7ff1881f1ab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff184ff9700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff1881e3ba0 0x7ff1881f1ab0 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff178009ba0 tx=0x7ff178011000 comp rx=0 tx=0).stop 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff174066730 msgr2=0x7ff174068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff174066730 0x7ff174068bf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff180001560 tx=0x7ff180009040 comp rx=0 tx=0).stop 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cc3b0 msgr2=0x7ff1880c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 --2- 172.21.15.88:0/1877710195 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff1880cc3b0 0x7ff1880c4180 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff17c00c700 tx=0x7ff17c00ca10 comp rx=0 tx=0).stop 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18cffd700 1 -- 172.21.15.88:0/1877710195 reap_dead start 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18cffd700 1 -- 172.21.15.88:0/1877710195 reap_dead start 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 shutdown_connections 2024-09-13T18:07:32.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 >> 172.21.15.88:0/1877710195 conn(0x7ff188066270 msgr2=0x7ff18806ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:32.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 shutdown_connections 2024-09-13T18:07:32.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:32.909+0000 7ff18d7fe700 1 -- 172.21.15.88:0/1877710195 wait complete. 2024-09-13T18:07:32.928 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:07:32.928 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2024-09-13T18:07:32.928 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T18:07:32.928 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-09-13T18:07:32.928 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:07:32.928 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:07:32.928 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:07:32.977 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:07:32.977 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-13T18:07:32.977 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.085+0000 7f2fbbfff700 1 Processor -- start 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.085+0000 7f2fbbfff700 1 -- start start 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 0x7f2fbc152f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 0x7f2fbc153450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc06f590 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5ab0 con 0x7f2fbc0ca950 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc159ac0 con 0x7f2fbc0ca570 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fb3fff700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 msgr2=0x7f2fbc153450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fb3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 0x7f2fbc153450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:33.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 0x7f2fbc152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbb7fe700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f2fbc0c3c20 0x7f2fbc06fa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:59352/0 (socket says 172.21.15.88:59352) 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbb7fe700 1 -- 172.21.15.88:0/2220895530 learned_addr learned my addr 172.21.15.88:0/2220895530 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fba7fc700 1 -- 172.21.15.88:0/2220895530 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701924837 0 0) 0x7f2fbc06f590 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fba7fc700 1 -- 172.21.15.88:0/2220895530 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa80035d0 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 -- 172.21.15.88:0/2220895530 >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 msgr2=0x7f2fbc153450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 --2- 172.21.15.88:0/2220895530 >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 0x7f2fbc153450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 -- 172.21.15.88:0/2220895530 >> v1:172.21.15.94:6789/0 conn(0x7f2fbc0c3c20 legacy=0x7f2fbc06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 -- 172.21.15.88:0/2220895530 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc159fb0 con 0x7f2fbc0ca570 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbaffd700 1 --2- 172.21.15.88:0/2220895530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 0x7f2fbc152f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009850 tx=0x7f2fac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51b8cff536054 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fba7fc700 1 -- 172.21.15.88:0/2220895530 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac011830 con 0x7f2fbc0ca570 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fba7fc700 1 -- 172.21.15.88:0/2220895530 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac011990 con 0x7f2fbc0ca570 2024-09-13T18:07:33.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fba7fc700 1 -- 172.21.15.88:0/2220895530 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac011d20 con 0x7f2fbc0ca570 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- 172.21.15.88:0/2220895530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 msgr2=0x7f2fbc152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/2220895530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 0x7f2fbc152f10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009850 tx=0x7f2fac009b60 comp rx=0 tx=0).stop 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- 172.21.15.88:0/2220895530 shutdown_connections 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/2220895530 >> v2:172.21.15.88:3300/0 conn(0x7f2fbc0ca950 0x7f2fbc153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/2220895530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0ca570 0x7f2fbc152f10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- 172.21.15.88:0/2220895530 >> 172.21.15.88:0/2220895530 conn(0x7f2fbc0cb3f0 msgr2=0x7f2fbc0cb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- 172.21.15.88:0/2220895530 shutdown_connections 2024-09-13T18:07:33.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.089+0000 7f2fbbfff700 1 -- 172.21.15.88:0/2220895530 wait complete. 2024-09-13T18:07:33.101 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 Processor -- start 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 -- start start 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 0x7f2fbc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 0x7f2fbc14f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc153cd0 con 0x7f2fbc0ca570 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1f2750 con 0x7f2fbc0ca950 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbbfff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1f2a30 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fb3fff700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 msgr2=0x7f2fbc14d9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fb3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 0x7f2fbc14d9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.102 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:42244/0 (socket says 172.21.15.88:42244) 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 -- 172.21.15.88:0/1938172650 learned_addr learned my addr 172.21.15.88:0/1938172650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbb7fe700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 0x7f2fbc14f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 -- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 msgr2=0x7f2fbc14f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 0x7f2fbc14f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 -- 172.21.15.88:0/1938172650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 msgr2=0x7f2fbc14d9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 0x7f2fbc14d9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbaffd700 1 -- 172.21.15.88:0/1938172650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094b0 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.093+0000 7f2fbb7fe700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 0x7f2fbc14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fbaffd700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ba0 tx=0x7f2fac004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.103 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0038c0 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac01f070 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc14e7b0 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac003c20 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc14ed70 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc15a200 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.104 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f2fac01a430 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 0x7f2f9c068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2fac021070 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.097+0000 7f2fb3fff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 0x7f2f9c068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:33.105 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.101+0000 7f2fb3fff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 0x7f2f9c068ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc156b20 tx=0x7f2fa4009270 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:33.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.109+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2fac053040 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.393+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f2fbc070c80 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.393+0000 7f2fb8ff9700 1 -- 172.21.15.88:0/1938172650 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f2fac02b620 con 0x7f2fbc0c3c20 2024-09-13T18:07:33.396 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 msgr2=0x7f2f9c068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 0x7f2f9c068ba0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc156b20 tx=0x7f2fa4009270 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 msgr2=0x7f2fbc0cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009ba0 tx=0x7f2fac004770 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 shutdown_connections 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2f9c0666e0 0x7f2f9c068ba0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2fbc0ca950 0x7f2fbc14f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fbc0ca570 0x7f2fbc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 --2- 172.21.15.88:0/1938172650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2fbc0c3c20 0x7f2fbc0cdb40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 >> 172.21.15.88:0/1938172650 conn(0x7f2fbc0cb3f0 msgr2=0x7f2fbc0c4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 shutdown_connections 2024-09-13T18:07:33.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:33.397+0000 7f2fbbfff700 1 -- 172.21.15.88:0/1938172650 wait complete. 2024-09-13T18:07:33.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:07:33.810 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:07:36.415 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:36.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 Processor -- start 2024-09-13T18:07:36.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 -- start start 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff3bc150f90 0x7ff3bc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc06f040 con 0x7ff3bc0c5940 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc06f2e0 con 0x7ff3bc151370 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c3020700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3bc06f5c0 con 0x7ff3bc150f90 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c281f700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7ff3bc0c5940 legacy=0x7ff3bc161690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c181d700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff3bc151370 0x7ff3bc06c9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:59360/0 (socket says 172.21.15.88:59360) 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c181d700 1 -- 172.21.15.88:0/4255830718 learned_addr learned my addr 172.21.15.88:0/4255830718 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:36.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c201e700 1 --2- 172.21.15.88:0/4255830718 >> v2:172.21.15.94:3300/0 conn(0x7ff3bc150f90 0x7ff3bc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c101c700 1 -- 172.21.15.88:0/4255830718 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005413400 0 0) 0x7ff3bc06f2e0 con 0x7ff3bc151370 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.517+0000 7ff3c101c700 1 -- 172.21.15.88:0/4255830718 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a80035d0 con 0x7ff3bc151370 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c201e700 1 -- 172.21.15.88:0/4255830718 >> v1:172.21.15.94:6789/0 conn(0x7ff3bc151370 legacy=0x7ff3bc06c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c201e700 1 -- 172.21.15.88:0/4255830718 >> v1:172.21.15.88:6789/0 conn(0x7ff3bc0c5940 legacy=0x7ff3bc161690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c201e700 1 -- 172.21.15.88:0/4255830718 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc06f8a0 con 0x7ff3bc150f90 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c201e700 1 --2- 172.21.15.88:0/4255830718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc150f90 0x7ff3bc0b1040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009850 tx=0x7ff3b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ad8b334265807de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c101c700 1 -- 172.21.15.88:0/4255830718 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8004230 con 0x7ff3bc150f90 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c101c700 1 -- 172.21.15.88:0/4255830718 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b8004390 con 0x7ff3bc150f90 2024-09-13T18:07:36.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c101c700 1 -- 172.21.15.88:0/4255830718 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80036c0 con 0x7ff3bc150f90 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- 172.21.15.88:0/4255830718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc150f90 msgr2=0x7ff3bc0b1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 --2- 172.21.15.88:0/4255830718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc150f90 0x7ff3bc0b1040 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009850 tx=0x7ff3b8009b60 comp rx=0 tx=0).stop 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- 172.21.15.88:0/4255830718 shutdown_connections 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 --2- 172.21.15.88:0/4255830718 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc150f90 0x7ff3bc0b1040 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- 172.21.15.88:0/4255830718 >> 172.21.15.88:0/4255830718 conn(0x7ff3bc0c7a40 msgr2=0x7ff3bc0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- 172.21.15.88:0/4255830718 shutdown_connections 2024-09-13T18:07:36.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- 172.21.15.88:0/4255830718 wait complete. 2024-09-13T18:07:36.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 Processor -- start 2024-09-13T18:07:36.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.521+0000 7ff3c3020700 1 -- start start 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 0x7ff3bc0aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc157dd0 con 0x7ff3bc1dce70 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc1f2c80 con 0x7ff3bc0c5940 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc1ef140 con 0x7ff3bc150f90 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c281f700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 msgr2=0x7ff3bc0aed40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c281f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 0x7ff3bc0aed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c201e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.528 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:42260/0 (socket says 172.21.15.88:42260) 2024-09-13T18:07:36.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c201e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:56454/0 (socket says 172.21.15.88:56454) 2024-09-13T18:07:36.529 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 -- 172.21.15.88:0/1176455461 learned_addr learned my addr 172.21.15.88:0/1176455461 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 -- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 msgr2=0x7ff3bc1f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 -- 172.21.15.88:0/1176455461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 msgr2=0x7ff3bc0aed40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 0x7ff3bc0aed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 -- 172.21.15.88:0/1176455461 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b80094b0 con 0x7ff3bc150f90 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c201e700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c181d700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c500 tx=0x7ff3ac00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac005d90 con 0x7ff3bc150f90 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc0c1c20 con 0x7ff3bc150f90 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ac0070d0 con 0x7ff3bc150f90 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ac007480 con 0x7ff3bc150f90 2024-09-13T18:07:36.530 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc1eeaf0 con 0x7ff3bc150f90 2024-09-13T18:07:36.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.525+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0b1040 con 0x7ff3bc150f90 2024-09-13T18:07:36.531 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.529+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3ac0075e0 con 0x7ff3bc150f90 2024-09-13T18:07:36.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.529+0000 7ff3b2ffd700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 0x7ff3a0068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:36.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.529+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff3ac083820 con 0x7ff3bc150f90 2024-09-13T18:07:36.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.529+0000 7ff3c201e700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 0x7ff3a0068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:36.533 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.529+0000 7ff3c201e700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 0x7ff3a0068bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009850 tx=0x7ff3b8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:36.540 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.537+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3ac050b60 con 0x7ff3bc150f90 2024-09-13T18:07:36.819 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.817+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7ff3bc1ef280 con 0x7ff3bc150f90 2024-09-13T18:07:36.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.817+0000 7ff3b2ffd700 1 -- 172.21.15.88:0/1176455461 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7ff3ac017080 con 0x7ff3bc150f90 2024-09-13T18:07:36.820 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 msgr2=0x7ff3a0068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 0x7ff3a0068bd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8009850 tx=0x7ff3b8008030 comp rx=0 tx=0).stop 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 msgr2=0x7ff3bc1e19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac00c500 tx=0x7ff3ac00c810 comp rx=0 tx=0).stop 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 shutdown_connections 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3a0066710 0x7ff3a0068bd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3bc150f90 0x7ff3bc1e19b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3bc1dce70 0x7ff3bc0aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.824 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 --2- 172.21.15.88:0/1176455461 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3bc0c5940 0x7ff3bc1f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 >> 172.21.15.88:0/1176455461 conn(0x7ff3bc0c7a40 msgr2=0x7ff3bc06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 shutdown_connections 2024-09-13T18:07:36.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:36.821+0000 7ff3c3020700 1 -- 172.21.15.88:0/1176455461 wait complete. 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 rewriters = 66878.37 kB/sec 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 rewriters = 66875.55 kB/sec 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 66878.37 kB/sec 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 66878.37 kB/sec 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 66878.37 kB/sec 2024-09-13T18:07:39.747 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:07:39.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 Processor -- start 2024-09-13T18:07:39.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 -- start start 2024-09-13T18:07:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960153260 0x7f09600cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0960158f40 0x7f09600707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0960159810 con 0x7f096006fc60 2024-09-13T18:07:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0960159ad0 con 0x7f0960158f40 2024-09-13T18:07:39.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09658ad700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960159db0 con 0x7f0960153260 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09650ac700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0960158f40 0x7f09600707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f095ffff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f096006fc60 0x7f09600c3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:59372/0 (socket says 172.21.15.88:59372) 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09648ab700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960153260 0x7f09600cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f095ffff700 1 -- 172.21.15.88:0/807235428 learned_addr learned my addr 172.21.15.88:0/807235428 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.953+0000 7f09650ac700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0960158f40 0x7f09600707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:56458/0 (socket says 172.21.15.88:56458) 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09650ac700 1 -- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960153260 msgr2=0x7f09600cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09650ac700 1 --2- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960153260 0x7f09600cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:39.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09650ac700 1 -- 172.21.15.88:0/807235428 >> v1:172.21.15.94:6789/0 conn(0x7f096006fc60 legacy=0x7f09600c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:39.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09650ac700 1 -- 172.21.15.88:0/807235428 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096006eea0 con 0x7f0960158f40 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09650ac700 1 --2- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960158f40 0x7f09600707d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e0ec88c0124b00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f095f7fe700 1 -- 172.21.15.88:0/807235428 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800e070 con 0x7f0960158f40 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f095f7fe700 1 -- 172.21.15.88:0/807235428 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800bb20 con 0x7f0960158f40 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f095f7fe700 1 -- 172.21.15.88:0/807235428 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0958012430 con 0x7f0960158f40 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960158f40 msgr2=0x7f09600707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 --2- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960158f40 0x7f09600707d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095800b330 comp rx=0 tx=0).stop 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- 172.21.15.88:0/807235428 shutdown_connections 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 --2- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960158f40 0x7f09600707d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 --2- 172.21.15.88:0/807235428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960153260 0x7f09600cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:39.961 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- 172.21.15.88:0/807235428 >> 172.21.15.88:0/807235428 conn(0x7f09600cefa0 msgr2=0x7f09600cb3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- 172.21.15.88:0/807235428 shutdown_connections 2024-09-13T18:07:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- 172.21.15.88:0/807235428 wait complete. 2024-09-13T18:07:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 Processor -- start 2024-09-13T18:07:39.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.957+0000 7f09658ad700 1 -- start start 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 0x7f0960154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960158f40 0x7f09601ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600b3c10 con 0x7f096006fc60 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09601552d0 con 0x7f0960153260 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960153fb0 con 0x7f0960158f40 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09648ab700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 msgr2=0x7f0960154b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:39.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09648ab700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 0x7f0960154b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:56468/0 (socket says 172.21.15.88:56468) 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 -- 172.21.15.88:0/824682688 learned_addr learned my addr 172.21.15.88:0/824682688 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09650ac700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960158f40 0x7f09601ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 -- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960158f40 msgr2=0x7f09601ef9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960158f40 0x7f09601ef9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 -- 172.21.15.88:0/824682688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 msgr2=0x7f0960154b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 0x7f0960154b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:39.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 -- 172.21.15.88:0/824682688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009a70 con 0x7f0960153260 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095ffff700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f095000c700 tx=0x7f095000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950005d90 con 0x7f0960153260 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09500070d0 con 0x7f0960153260 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09600b4030 con 0x7f0960153260 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950007440 con 0x7f0960153260 2024-09-13T18:07:39.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.961+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09600b3270 con 0x7f0960153260 2024-09-13T18:07:39.967 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0960159370 con 0x7f0960153260 2024-09-13T18:07:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f09500075a0 con 0x7f0960153260 2024-09-13T18:07:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f095d7fa700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 0x7f094c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0950083530 con 0x7f0960153260 2024-09-13T18:07:39.968 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f09648ab700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 0x7f094c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:39.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.965+0000 7f09648ab700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 0x7f094c068bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09540095a0 tx=0x7f0954009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:39.977 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:39.973+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0950050850 con 0x7f0960153260 2024-09-13T18:07:40.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.209+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f09600c55c0 con 0x7f0960153260 2024-09-13T18:07:40.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.209+0000 7f095d7fa700 1 -- 172.21.15.88:0/824682688 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f0950053e70 con 0x7f0960153260 2024-09-13T18:07:40.214 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:40.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 msgr2=0x7f094c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:40.216 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 0x7f094c068bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f09540095a0 tx=0x7f0954009240 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 msgr2=0x7f09601495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f095000c700 tx=0x7f095000ca10 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 shutdown_connections 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f094c066710 0x7f094c068bd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0960158f40 0x7f09601ef9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0960153260 0x7f09601495e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 --2- 172.21.15.88:0/824682688 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f096006fc60 0x7f0960154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 >> 172.21.15.88:0/824682688 conn(0x7f09600cefa0 msgr2=0x7f09601e3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 shutdown_connections 2024-09-13T18:07:40.217 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:40.213+0000 7f09658ad700 1 -- 172.21.15.88:0/824682688 wait complete. 2024-09-13T18:07:43.229 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:07:43.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.341+0000 7fc319baa700 1 Processor -- start 2024-09-13T18:07:43.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.341+0000 7fc319baa700 1 -- start start 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc319baa700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc319baa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc319baa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc314158430 con 0x7fc3140c1600 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc319baa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc314158fb0 con 0x7fc314155550 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc319baa700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140c67e0 con 0x7fc31414bd90 2024-09-13T18:07:43.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc313fff700 1 -- >> v1:172.21.15.88:6789/0 conn(0x7fc3140c1600 legacy=0x7fc314154e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc3193a9700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 msgr2=0x7fc3140c5b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc3193a9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:44166/0 (socket says 172.21.15.88:44166) 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 learned_addr learned my addr 172.21.15.88:0/1802197350 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:43.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.345+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v1:172.21.15.88:6789/0 conn(0x7fc3140c1600 legacy=0x7fc314154e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc3193a9700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 msgr2=0x7fc3140c5b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:07:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:07:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:43.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.549+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:07:43.912 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:43.912 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 readers = 6027753.00 kB/sec 2024-09-13T18:07:43.912 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 readers = 6007588.87 kB/sec 2024-09-13T18:07:43.913 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 6027753.00 kB/sec 2024-09-13T18:07:43.913 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 6027753.00 kB/sec 2024-09-13T18:07:43.913 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 6027753.00 kB/sec 2024-09-13T18:07:43.913 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:07:43.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v1:172.21.15.88:6789/0 conn(0x7fc3140c1600 legacy=0x7fc314154e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc3193a9700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 msgr2=0x7fc3140c5b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:43.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:43.957 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:43.953+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:07:44.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc3193a9700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 msgr2=0x7fc3140c5b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v1:172.21.15.88:6789/0 conn(0x7fc3140c1600 legacy=0x7fc314154e40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.88:6789/0 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:44.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:44.757+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 re-readers = 5269811.50 kB/sec 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 re-readers = 5257099.68 kB/sec 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 5269811.50 kB/sec 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 5269811.50 kB/sec 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 5269811.50 kB/sec 2024-09-13T18:07:46.261 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 msgr2=0x7fc3140c5640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc31414bd90 0x7fc3140c5640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 msgr2=0x7fc3140c5b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.88:3300/0 conn(0x7fc314155550 0x7fc3140c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 -- 172.21.15.88:0/1802197350 >> v1:172.21.15.88:6789/0 conn(0x7fc3140c1600 legacy=0x7fc314154e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 -- 172.21.15.88:0/1802197350 --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc314158680 con 0x7fc2f4003720 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc3127fc700 1 -- 172.21.15.88:0/1802197350 --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc314158fb0 con 0x7fc2f4007460 2024-09-13T18:07:46.348 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:07:46.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:46.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:46.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.345+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:46.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.549+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.549+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:07:46.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.549+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:46.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.549+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:46.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.549+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:07:46.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.953+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.953+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:07:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.953+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:07:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.953+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:07:46.956 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:46.953+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:07:47.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898156140 0 0) 0x7fc314158680 con 0x7fc2f4003720 2024-09-13T18:07:47.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3000035d0 con 0x7fc2f4003720 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628348056 0 0) 0x7fc3000035d0 con 0x7fc2f4003720 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 msgr2=0x7fc2f4009920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 --2- 172.21.15.88:0/1802197350 >> v2:172.21.15.94:3300/0 conn(0x7fc2f4007460 0x7fc2f4009920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314158430 con 0x7fc2f4003720 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fc2fc00c570 con 0x7fc2f4003720 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 >> v1:172.21.15.94:6789/0 conn(0x7fc2f4003720 legacy=0x7fc2f4005ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.233+0000 7fc3193a9700 1 -- 172.21.15.88:0/1802197350 reap_dead start 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc300003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc300004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc30000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314158fb0 con 0x7fc300004870 2024-09-13T18:07:47.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c1b0 con 0x7fc300003a20 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c370 con 0x7fc300005280 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc313fff700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 msgr2=0x7fc300004cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc313fff700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc300004cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc300003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc30000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 msgr2=0x7fc30000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc30000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 msgr2=0x7fc300004cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc300004cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 -- 172.21.15.88:0/1802197350 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000035d0 con 0x7fc300003a20 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc300003e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc006bc0 tx=0x7fc3000058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350823a17e96aae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00cad0 con 0x7fc300003a20 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2fc00c040 con 0x7fc300003a20 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc3137fe700 1 -- 172.21.15.88:0/1802197350 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc014cd0 con 0x7fc300003a20 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 -- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 msgr2=0x7fc300003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc300003e20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc006bc0 tx=0x7fc3000058a0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 -- 172.21.15.88:0/1802197350 shutdown_connections 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc30000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc300004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 --2- 172.21.15.88:0/1802197350 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc300003e20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 -- 172.21.15.88:0/1802197350 >> 172.21.15.88:0/1802197350 conn(0x7fc3140ca720 msgr2=0x7fc3140cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 -- 172.21.15.88:0/1802197350 shutdown_connections 2024-09-13T18:07:47.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.237+0000 7fc319baa700 1 -- 172.21.15.88:0/1802197350 wait complete. 2024-09-13T18:07:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.241+0000 7fc319baa700 1 Processor -- start 2024-09-13T18:07:47.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.241+0000 7fc319baa700 1 -- start start 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc314162cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc3140c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3141628d0 con 0x7fc300004870 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314163900 con 0x7fc300003a20 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc314163230 con 0x7fc300005280 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc313fff700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 msgr2=0x7fc3140c9d20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc313fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc3140c9d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc318ba8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc314162cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:44194/0 (socket says 172.21.15.88:44194) 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 -- 172.21.15.88:0/1610036879 learned_addr learned my addr 172.21.15.88:0/1610036879 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 -- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 msgr2=0x7fc314162cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc314162cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 -- 172.21.15.88:0/1610036879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 msgr2=0x7fc3140c9d20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc3140c9d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 -- 172.21.15.88:0/1610036879 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3141ef1d0 con 0x7fc300005280 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3193a9700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc314073ce0 tx=0x7fc30c00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c008070 con 0x7fc300005280 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c009040 con 0x7fc300005280 2024-09-13T18:07:47.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc314162210 con 0x7fc300005280 2024-09-13T18:07:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00c9e0 con 0x7fc300005280 2024-09-13T18:07:47.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.245+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3141568f0 con 0x7fc300005280 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc314162a10 con 0x7fc300005280 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc30c015020 con 0x7fc300005280 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc3117fa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 0x7fc2f4069310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc30c083fa0 con 0x7fc300005280 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 0x7fc2f4069310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.249+0000 7fc318ba8700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 0x7fc2f4069310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc001eb0 tx=0x7fc2fc022040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.257+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc30c0b5db0 con 0x7fc300005280 2024-09-13T18:07:47.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.477+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fc314061fa0 con 0x7fc300005280 2024-09-13T18:07:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.477+0000 7fc3117fa700 1 -- 172.21.15.88:0/1610036879 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1533 (secure 0 0 0) 0x7fc30c01d080 con 0x7fc300005280 2024-09-13T18:07:47.482 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":24,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 msgr2=0x7fc2f4069310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 0x7fc2f4069310 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc001eb0 tx=0x7fc2fc022040 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 msgr2=0x7fc31414ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc314073ce0 tx=0x7fc30c00ed60 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 shutdown_connections 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc2f4066e50 0x7fc2f4069310 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc300005280 0x7fc31414ab10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc300004870 0x7fc3140c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 --2- 172.21.15.88:0/1610036879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc300003a20 0x7fc314162cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 >> 172.21.15.88:0/1610036879 conn(0x7fc3140ca720 msgr2=0x7fc314157410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 shutdown_connections 2024-09-13T18:07:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.481+0000 7fc319baa700 1 -- 172.21.15.88:0/1610036879 wait complete. 2024-09-13T18:07:47.495 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-13T18:07:47.495 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-13T18:07:47.495 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:07:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 Processor -- start 2024-09-13T18:07:47.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 -- start start 2024-09-13T18:07:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 0x7fd2900c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd290156e50 con 0x7fd2900c1e00 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2901570f0 con 0x7fd2900c21e0 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2901573d0 con 0x7fd29015ad20 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28e7fc700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 msgr2=0x7fd2900c47c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 0x7fd2900c47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28f7fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28f7fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:44210/0 (socket says 172.21.15.88:44210) 2024-09-13T18:07:47.607 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.601+0000 7fd28f7fe700 1 -- 172.21.15.88:0/3933664674 learned_addr learned my addr 172.21.15.88:0/3933664674 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28f7fe700 1 -- 172.21.15.88:0/3933664674 >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 msgr2=0x7fd2900c47c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28f7fe700 1 --2- 172.21.15.88:0/3933664674 >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 0x7fd2900c47c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28f7fe700 1 -- 172.21.15.88:0/3933664674 >> v1:172.21.15.94:6789/0 conn(0x7fd2900c1e00 legacy=0x7fd29015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28f7fe700 1 -- 172.21.15.88:0/3933664674 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2901576b0 con 0x7fd29015ad20 2024-09-13T18:07:47.609 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28f7fe700 1 --2- 172.21.15.88:0/3933664674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd288009e50 tx=0x7fd28800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fb35f13f3832723 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28dffb700 1 -- 172.21.15.88:0/3933664674 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800e070 con 0x7fd29015ad20 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28dffb700 1 -- 172.21.15.88:0/3933664674 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28800b9c0 con 0x7fd29015ad20 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28dffb700 1 -- 172.21.15.88:0/3933664674 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28800bd70 con 0x7fd29015ad20 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 -- 172.21.15.88:0/3933664674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 msgr2=0x7fd290150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 --2- 172.21.15.88:0/3933664674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd288009e50 tx=0x7fd28800b330 comp rx=0 tx=0).stop 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 -- 172.21.15.88:0/3933664674 shutdown_connections 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 --2- 172.21.15.88:0/3933664674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd29015ad20 0x7fd290150ac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 --2- 172.21.15.88:0/3933664674 >> v2:172.21.15.88:3300/0 conn(0x7fd2900c21e0 0x7fd2900c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 -- 172.21.15.88:0/3933664674 >> 172.21.15.88:0/3933664674 conn(0x7fd2900664b0 msgr2=0x7fd29006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 -- 172.21.15.88:0/3933664674 shutdown_connections 2024-09-13T18:07:47.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.605+0000 7fd28ffff700 1 -- 172.21.15.88:0/3933664674 wait complete. 2024-09-13T18:07:47.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 Processor -- start 2024-09-13T18:07:47.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 -- start start 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 0x7fd290143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2900c21e0 0x7fd29014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd29015ad20 0x7fd29014b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29014cfe0 con 0x7fd29015ad20 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290143f30 con 0x7fd2900c21e0 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2901e0aa0 con 0x7fd2900c1e00 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28f7fe700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd29015ad20 msgr2=0x7fd29014b510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd29015ad20 0x7fd29014b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28effd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 0x7fd290143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28effd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 0x7fd290143880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:44214/0 (socket says 172.21.15.88:44214) 2024-09-13T18:07:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28effd700 1 -- 172.21.15.88:0/2299762816 learned_addr learned my addr 172.21.15.88:0/2299762816 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:47.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.609+0000 7fd28e7fc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2900c21e0 0x7fd29014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2900c21e0 msgr2=0x7fd29014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2900c21e0 0x7fd29014afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd29015ad20 msgr2=0x7fd29014b510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd29015ad20 0x7fd29014b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd288009b30 con 0x7fd2900c1e00 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28e7fc700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2900c21e0 0x7fd29014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28effd700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 0x7fd290143880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c500 tx=0x7fd28000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800052d0 con 0x7fd2900c1e00 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd280005430 con 0x7fd2900c1e00 2024-09-13T18:07:47.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2901e0d80 con 0x7fd2900c1e00 2024-09-13T18:07:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2800055a0 con 0x7fd2900c1e00 2024-09-13T18:07:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2901e1340 con 0x7fd2900c1e00 2024-09-13T18:07:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28ffff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 0x7fd29013dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290068400 con 0x7fd2901e1500 2024-09-13T18:07:47.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28e7fc700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 0x7fd29013dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28e7fc700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd29006f6b0 con 0x7fd2901e1500 2024-09-13T18:07:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.613+0000 7fd28e7fc700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 0x7fd29013dd70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd290150700 tx=0x7fd278005980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27800e860 con 0x7fd2901e1500 2024-09-13T18:07:47.619 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd2800038e0 con 0x7fd2900c1e00 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd2740667d0 0x7fd274068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd280083570 con 0x7fd2900c1e00 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd28f7fe700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd2740667d0 0x7fd274068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fd27800e9c0 con 0x7fd2901e1500 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 msgr2=0x7fd29013dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.620 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 0x7fd29013dd70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd290150700 tx=0x7fd278005980 comp rx=0 tx=0).stop 2024-09-13T18:07:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 msgr2=0x7fd29013dd70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd287fff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2901e1500 0x7fd29013dd70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.617+0000 7fd28f7fe700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd2740667d0 0x7fd274068c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd28800b370 tx=0x7fd288009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.629+0000 7fd28ffff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 0x7fd2900c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.629+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290157c70 con 0x7fd29013e2b0 2024-09-13T18:07:47.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.629+0000 7fd28e7fc700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 0x7fd2900c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28e7fc700 1 -- 172.21.15.88:0/2299762816 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fd29006de90 con 0x7fd29013e2b0 2024-09-13T18:07:47.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28e7fc700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 0x7fd2900c5a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd29015ab40 tx=0x7fd278005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd278006050 con 0x7fd29013e2b0 2024-09-13T18:07:47.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4938 (secure 0 0 0) 0x7fd2780061b0 con 0x7fd29013e2b0 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 msgr2=0x7fd2900c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 0x7fd2900c5a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd29015ab40 tx=0x7fd278005a80 comp rx=0 tx=0).stop 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 msgr2=0x7fd2900c5a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd287fff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd29013e2b0 0x7fd2900c5a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:07:47.637 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 24, 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.638 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.639 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:47.640 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.641 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.642 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.643 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.644 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.645 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.646 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:47.647 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.648 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.649 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:47.650 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.651 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:07:47.652 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:47.653 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd2740667d0 msgr2=0x7fd274068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd2740667d0 0x7fd274068c90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd28800b370 tx=0x7fd288009000 comp rx=0 tx=0).stop 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 msgr2=0x7fd290143880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 --2- 172.21.15.88:0/2299762816 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2900c1e00 0x7fd290143880 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd28000c500 tx=0x7fd28000c810 comp rx=0 tx=0).stop 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28f7fe700 1 -- 172.21.15.88:0/2299762816 reap_dead start 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28f7fe700 1 -- 172.21.15.88:0/2299762816 reap_dead start 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 shutdown_connections 2024-09-13T18:07:47.655 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 >> 172.21.15.88:0/2299762816 conn(0x7fd2900664b0 msgr2=0x7fd29014db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 shutdown_connections 2024-09-13T18:07:47.656 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.633+0000 7fd28ffff700 1 -- 172.21.15.88:0/2299762816 wait complete. 2024-09-13T18:07:47.656 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:07:47.656 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2024-09-13T18:07:47.656 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:07:47.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.765+0000 7f3b70de4700 1 Processor -- start 2024-09-13T18:07:47.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- start start 2024-09-13T18:07:47.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 0x7f3b6c06f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c0c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b6c070400 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6c0b2260 con 0x7f3b6c06eea0 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c06f7c0 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6b7fe700 1 -- >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 msgr2=0x7f3b6c06f280 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 0x7f3b6c06f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b63fff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3b6c06fbe0 0x7f3b6c0cac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:39402/0 (socket says 172.21.15.88:39402) 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b63fff700 1 -- 172.21.15.88:0/3955722250 learned_addr learned my addr 172.21.15.88:0/3955722250 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 --2- 172.21.15.88:0/3955722250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c0c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6affd700 1 -- 172.21.15.88:0/3955722250 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869404356 0 0) 0x7f3b6c070400 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6affd700 1 -- 172.21.15.88:0/3955722250 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b580035d0 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 -- 172.21.15.88:0/3955722250 >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 msgr2=0x7f3b6c06f280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 --2- 172.21.15.88:0/3955722250 >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 0x7f3b6c06f280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 -- 172.21.15.88:0/3955722250 >> v1:172.21.15.94:6789/0 conn(0x7f3b6c06fbe0 legacy=0x7f3b6c0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 -- 172.21.15.88:0/3955722250 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0c9dc0 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6bfff700 1 --2- 172.21.15.88:0/3955722250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c0c9880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009d90 tx=0x7f3b6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ea19d676e5eb43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6affd700 1 -- 172.21.15.88:0/3955722250 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400e070 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6affd700 1 -- 172.21.15.88:0/3955722250 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400bb20 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b6affd700 1 -- 172.21.15.88:0/3955722250 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64012430 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- 172.21.15.88:0/3955722250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 msgr2=0x7f3b6c0c9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 --2- 172.21.15.88:0/3955722250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c0c9880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009d90 tx=0x7f3b6400b330 comp rx=0 tx=0).stop 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- 172.21.15.88:0/3955722250 shutdown_connections 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 --2- 172.21.15.88:0/3955722250 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c0c9880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 --2- 172.21.15.88:0/3955722250 >> v2:172.21.15.88:3300/0 conn(0x7f3b6c06eea0 0x7f3b6c06f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- 172.21.15.88:0/3955722250 >> 172.21.15.88:0/3955722250 conn(0x7f3b6c0cefa0 msgr2=0x7f3b6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- 172.21.15.88:0/3955722250 shutdown_connections 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.769+0000 7f3b70de4700 1 -- 172.21.15.88:0/3955722250 wait complete. 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 Processor -- start 2024-09-13T18:07:47.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 -- start start 2024-09-13T18:07:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b6c06eea0 0x7f3b6c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c14ae40 con 0x7f3b6c06eea0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0c6510 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b70de4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c0b4b90 con 0x7f3b6c0c93f0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b6b7fe700 1 -- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b6c06eea0 msgr2=0x7f3b6c0c5cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.88:3300/0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b6c06eea0 0x7f3b6c0c5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:57380/0 (socket says 172.21.15.88:57380) 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 -- 172.21.15.88:0/1522873766 learned_addr learned my addr 172.21.15.88:0/1522873766 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 msgr2=0x7f3b6c1f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0c93f0 0x7f3b6c1f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b6c06eea0 msgr2=0x7f3b6c0c5cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3b6c06eea0 0x7f3b6c0c5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009a70 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.773+0000 7f3b63fff700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c700 tx=0x7f3b5400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005d90 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b540070d0 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c0b3f80 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b54007480 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c0b4540 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b70de4700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 0x7f3b6c1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c06e910 con 0x7f3b6c0b4760 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b6b7fe700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 0x7f3b6c1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b6b7fe700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b6c1596a0 con 0x7f3b6c0b4760 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b6b7fe700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 0x7f3b6c1f2080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00bcc0 tx=0x7f3b5c009f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3b540075e0 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3b4c066710 0x7f3b4c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3b540836f0 con 0x7f3b6c06fbe0 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c003ab0 con 0x7f3b6c0b4760 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f3b5c003c10 con 0x7f3b6c0b4760 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 msgr2=0x7f3b6c1f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 0x7f3b6c1f2080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00bcc0 tx=0x7f3b5c009f30 comp rx=0 tx=0).stop 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 msgr2=0x7f3b6c1f2080 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:47.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b68ff9700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c0b4760 0x7f3b6c1f2080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.777+0000 7f3b6bfff700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3b4c066710 0x7f3b4c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.781+0000 7f3b6bfff700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3b4c066710 0x7f3b4c068bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b64014040 tx=0x7f3b64011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 0x7f3b6c149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:07:47.791 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c1593c0 con 0x7f3b6c14cf50 2024-09-13T18:07:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b6b7fe700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 0x7f3b6c149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:07:47.792 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b6b7fe700 1 -- 172.21.15.88:0/1522873766 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3b6c159980 con 0x7f3b6c14cf50 2024-09-13T18:07:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b6b7fe700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 0x7f3b6c149370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c014000 tx=0x7f3b5c005ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:07:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c01a990 con 0x7f3b6c14cf50 2024-09-13T18:07:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4770 (secure 0 0 0) 0x7f3b5c01aaf0 con 0x7f3b6c14cf50 2024-09-13T18:07:47.793 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 msgr2=0x7f3b6c149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 0x7f3b6c149370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c014000 tx=0x7f3b5c005ad0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 msgr2=0x7f3b6c149370 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b68ff9700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b6c14cf50 0x7f3b6c149370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 24, 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:07:47.794 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.795 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:07:47.796 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:07:47.797 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:07:47.798 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:07:47.799 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.800 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.801 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.802 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:07:47.803 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.804 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.805 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.806 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:07:47.807 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3b4c066710 msgr2=0x7f3b4c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3b4c066710 0x7f3b4c068bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3b64014040 tx=0x7f3b64011000 comp rx=0 tx=0).stop 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 msgr2=0x7f3b6c1e3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400c700 tx=0x7f3b5400ca10 comp rx=0 tx=0).stop 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b6bfff700 1 -- 172.21.15.88:0/1522873766 reap_dead start 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 shutdown_connections 2024-09-13T18:07:47.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 --2- 172.21.15.88:0/1522873766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b6c06fbe0 0x7f3b6c1e3b40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:07:47.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 >> 172.21.15.88:0/1522873766 conn(0x7f3b6c0cefa0 msgr2=0x7f3b6c066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:07:47.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 shutdown_connections 2024-09-13T18:07:47.810 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:07:47.789+0000 7f3b70de4700 1 -- 172.21.15.88:0/1522873766 wait complete. 2024-09-13T18:07:47.810 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:07:47.810 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T18:07:52.632 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.632 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.632 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.632 INFO:tasks.workunit.client.0.smithi088.stdout:iozone test complete. 2024-09-13T18:07:52.633 INFO:tasks.workunit.client.0.smithi088.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Version $Revision: 3.489 $ 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Compiled for 64 bit mode. 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Build: linux-AMD64 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:07:52.679 INFO:tasks.workunit.client.0.smithi088.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Run began: Fri Sep 13 18:07:52 2024 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Include close in write timing 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Include fsync in write timing 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: File size set to 1048576 kB 2024-09-13T18:07:52.680 INFO:tasks.workunit.client.0.smithi088.stdout: Record Size 1024 kB 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Output is in kBytes/sec 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: File stride size set to 17 * record size. 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Throughput test with 1 process 2024-09-13T18:07:52.681 INFO:tasks.workunit.client.0.smithi088.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 initial writers = 499561.66 kB/sec 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 initial writers = 499413.91 kB/sec 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 499561.66 kB/sec 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 499561.66 kB/sec 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 499561.66 kB/sec 2024-09-13T18:07:54.822 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:07:59.217 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:07:59.217 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 rewriters = 619936.75 kB/sec 2024-09-13T18:07:59.217 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 rewriters = 619686.96 kB/sec 2024-09-13T18:07:59.218 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 619936.75 kB/sec 2024-09-13T18:07:59.218 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 619936.75 kB/sec 2024-09-13T18:07:59.218 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 619936.75 kB/sec 2024-09-13T18:07:59.218 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:08:02.010 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:02.010 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 readers = 6217728.00 kB/sec 2024-09-13T18:08:02.010 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 readers = 6199454.09 kB/sec 2024-09-13T18:08:02.010 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 6217728.00 kB/sec 2024-09-13T18:08:02.010 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 6217728.00 kB/sec 2024-09-13T18:08:02.011 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 6217728.00 kB/sec 2024-09-13T18:08:02.011 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:08:03.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:08:03.861 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 re-readers = 5294954.50 kB/sec 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 re-readers = 5280212.67 kB/sec 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 5294954.50 kB/sec 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 5294954.50 kB/sec 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 5294954.50 kB/sec 2024-09-13T18:08:04.314 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 1048576.00 kB 2024-09-13T18:08:07.811 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-09-13T18:08:07.811 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-09-13T18:08:07.811 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:08:07.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:08:07.814 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:08:07.814 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:08:07.815 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.925+0000 7f3e29f84700 1 Processor -- start 2024-09-13T18:08:07.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.925+0000 7f3e29f84700 1 -- start start 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 0x7f3e24152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e240c1c90 con 0x7f3e24072320 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e240c6300 con 0x7f3e24071f40 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2406b9e0 con 0x7f3e2406ce20 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e22ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e24072320 0x7f3e2406c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54700/0 (socket says 172.21.15.88:54700) 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e22ffd700 1 -- 172.21.15.88:0/692920232 learned_addr learned my addr 172.21.15.88:0/692920232 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e237fe700 1 -- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 msgr2=0x7f3e2415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e237fe700 1 -- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 msgr2=0x7f3e2415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e237fe700 1 --2- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 --2- 172.21.15.88:0/692920232 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 0x7f3e24152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e237fe700 1 --2- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 -- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 msgr2=0x7f3e2415c7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 --2- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 -- 172.21.15.88:0/692920232 >> v1:172.21.15.88:6789/0 conn(0x7f3e24072320 legacy=0x7f3e2406c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 -- 172.21.15.88:0/692920232 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e2415d280 con 0x7f3e2406ce20 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e23fff700 1 --2- 172.21.15.88:0/692920232 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 0x7f3e24152ec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c6440 tx=0x7f3e1c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f0a9279e2042d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e227fc700 1 -- 172.21.15.88:0/692920232 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c016070 con 0x7f3e2406ce20 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e227fc700 1 -- 172.21.15.88:0/692920232 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00bbd0 con 0x7f3e2406ce20 2024-09-13T18:08:07.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e227fc700 1 -- 172.21.15.88:0/692920232 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c00e070 con 0x7f3e2406ce20 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- 172.21.15.88:0/692920232 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 msgr2=0x7f3e24152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 --2- 172.21.15.88:0/692920232 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 0x7f3e24152ec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e240c6440 tx=0x7f3e1c00b330 comp rx=0 tx=0).stop 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- 172.21.15.88:0/692920232 shutdown_connections 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 --2- 172.21.15.88:0/692920232 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e2406ce20 0x7f3e24152ec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 --2- 172.21.15.88:0/692920232 >> v2:172.21.15.88:3300/0 conn(0x7f3e24071f40 0x7f3e2415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- 172.21.15.88:0/692920232 >> 172.21.15.88:0/692920232 conn(0x7f3e240ca790 msgr2=0x7f3e240caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- 172.21.15.88:0/692920232 shutdown_connections 2024-09-13T18:08:07.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 -- 172.21.15.88:0/692920232 wait complete. 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.929+0000 7f3e29f84700 1 Processor -- start 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- start start 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 0x7f3e241e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e24072320 0x7f3e241f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241f1aa0 con 0x7f3e24071f40 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241e4440 con 0x7f3e2406ce20 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e241e25e0 con 0x7f3e24072320 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 0x7f3e241e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e23fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e24072320 0x7f3e241f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39088/0 (socket says 172.21.15.88:39088) 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 -- 172.21.15.88:0/3435466927 learned_addr learned my addr 172.21.15.88:0/3435466927 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:07.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 msgr2=0x7f3e24152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 msgr2=0x7f3e24152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e22ffd700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e24072320 msgr2=0x7f3e241f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e24072320 0x7f3e241f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 msgr2=0x7f3e24152e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 -- 172.21.15.88:0/3435466927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c009a70 con 0x7f3e2406ce20 2024-09-13T18:08:07.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e237fe700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 0x7f3e241e3f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800e7e0 tx=0x7f3e1800eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1800c070 con 0x7f3e2406ce20 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e18004020 con 0x7f3e2406ce20 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e24154730 con 0x7f3e2406ce20 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e18004410 con 0x7f3e2406ce20 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.933+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e24154cd0 con 0x7f3e2406ce20 2024-09-13T18:08:07.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.937+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e240c5e40 con 0x7f3e2406ce20 2024-09-13T18:08:07.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.937+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3e180036c0 con 0x7f3e2406ce20 2024-09-13T18:08:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.941+0000 7f3e0bfff700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 0x7f3e10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.941+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3e180843e0 con 0x7f3e2406ce20 2024-09-13T18:08:07.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.941+0000 7f3e22ffd700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 0x7f3e10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:07.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.941+0000 7f3e22ffd700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 0x7f3e10068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e24153770 tx=0x7f3e14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:07.953 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:07.949+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3e180516c0 con 0x7f3e2406ce20 2024-09-13T18:08:08.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.181+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f3e240c6c20 con 0x7f3e2406ce20 2024-09-13T18:08:08.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.181+0000 7f3e0bfff700 1 -- 172.21.15.88:0/3435466927 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f3e18004570 con 0x7f3e2406ce20 2024-09-13T18:08:08.185 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 msgr2=0x7f3e10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 0x7f3e10068bf0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3e24153770 tx=0x7f3e14009040 comp rx=0 tx=0).stop 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 msgr2=0x7f3e241e3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 0x7f3e241e3f00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800e7e0 tx=0x7f3e1800eaf0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 shutdown_connections 2024-09-13T18:08:08.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3e10066730 0x7f3e10068bf0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e24072320 0x7f3e241f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e24071f40 0x7f3e24152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 --2- 172.21.15.88:0/3435466927 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e2406ce20 0x7f3e241e3f00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 >> 172.21.15.88:0/3435466927 conn(0x7f3e240ca790 msgr2=0x7f3e240c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 shutdown_connections 2024-09-13T18:08:08.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.185+0000 7f3e29f84700 1 -- 172.21.15.88:0/3435466927 wait complete. 2024-09-13T18:08:08.200 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:08:08.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:08:08.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:08:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 Processor -- start 2024-09-13T18:08:08.312 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 -- start start 2024-09-13T18:08:08.314 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f258c153170 0x7f258c0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258c153550 con 0x7f258c06eea0 2024-09-13T18:08:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258c071810 con 0x7f258c153170 2024-09-13T18:08:08.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.309+0000 7f25930cb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c071ab0 con 0x7f258c070690 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25928ca700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f258c06eea0 0x7f258c155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54710/0 (socket says 172.21.15.88:54710) 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25928ca700 1 -- 172.21.15.88:0/3350561811 learned_addr learned my addr 172.21.15.88:0/3350561811 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 --2- 172.21.15.88:0/3350561811 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25920c9700 1 --2- 172.21.15.88:0/3350561811 >> v2:172.21.15.94:3300/0 conn(0x7f258c153170 0x7f258c0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25910c7700 1 -- 172.21.15.88:0/3350561811 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168701766 0 0) 0x7f258c153550 con 0x7f258c06eea0 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25910c7700 1 -- 172.21.15.88:0/3350561811 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25780035d0 con 0x7f258c06eea0 2024-09-13T18:08:08.316 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 -- 172.21.15.88:0/3350561811 >> v2:172.21.15.94:3300/0 conn(0x7f258c153170 msgr2=0x7f258c0c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 --2- 172.21.15.88:0/3350561811 >> v2:172.21.15.94:3300/0 conn(0x7f258c153170 0x7f258c0c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 -- 172.21.15.88:0/3350561811 >> v1:172.21.15.88:6789/0 conn(0x7f258c06eea0 legacy=0x7f258c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 -- 172.21.15.88:0/3350561811 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258c06fe40 con 0x7f258c070690 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25918c8700 1 --2- 172.21.15.88:0/3350561811 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0c6eb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f257c009850 tx=0x7f257c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4190f7b622ab0676 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25910c7700 1 -- 172.21.15.88:0/3350561811 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c011830 con 0x7f258c070690 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25910c7700 1 -- 172.21.15.88:0/3350561811 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c011990 con 0x7f258c070690 2024-09-13T18:08:08.317 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25910c7700 1 -- 172.21.15.88:0/3350561811 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c011d40 con 0x7f258c070690 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- 172.21.15.88:0/3350561811 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 msgr2=0x7f258c0c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- 172.21.15.88:0/3350561811 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0c6eb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f257c009850 tx=0x7f257c009b60 comp rx=0 tx=0).stop 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- 172.21.15.88:0/3350561811 shutdown_connections 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- 172.21.15.88:0/3350561811 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0c6eb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- 172.21.15.88:0/3350561811 >> v2:172.21.15.94:3300/0 conn(0x7f258c153170 0x7f258c0c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- 172.21.15.88:0/3350561811 >> 172.21.15.88:0/3350561811 conn(0x7f258c0cb590 msgr2=0x7f258c0c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.318 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- 172.21.15.88:0/3350561811 shutdown_connections 2024-09-13T18:08:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- 172.21.15.88:0/3350561811 wait complete. 2024-09-13T18:08:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 Processor -- start 2024-09-13T18:08:08.319 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 -- start start 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c06eea0 0x7f258c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.313+0000 7f25930cb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c1ed570 con 0x7f258c153170 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c152140 con 0x7f258c06eea0 2024-09-13T18:08:08.320 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258c1ec9f0 con 0x7f258c070690 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25918c8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39094/0 (socket says 172.21.15.88:39094) 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 -- 172.21.15.88:0/909181190 learned_addr learned my addr 172.21.15.88:0/909181190 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25920c9700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c06eea0 0x7f258c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 msgr2=0x7f258c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.321 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f258c070690 0x7f258c0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c06eea0 msgr2=0x7f258c153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f258c06eea0 0x7f258c153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0094b0 con 0x7f258c153170 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25928ca700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f258400caa0 tx=0x7f258400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584007480 con 0x7f258c153170 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258c1eccd0 con 0x7f258c153170 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25840075e0 con 0x7f258c153170 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2584007970 con 0x7f258c153170 2024-09-13T18:08:08.322 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c1ed290 con 0x7f258c153170 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 0x7f258c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c068400 con 0x7f258c1ec560 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25920c9700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 0x7f258c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25920c9700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f258c0c85f0 con 0x7f258c1ec560 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f25920c9700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 0x7f258c150990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25880119d0 tx=0x7f2588011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.317+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588004240 con 0x7f258c1ec560 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f258401b3b0 con 0x7f258c153170 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f25700667d0 0x7f2570068c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.324 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f2584083c10 con 0x7f258c153170 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f25880043a0 con 0x7f258c1ec560 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 msgr2=0x7f258c150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 0x7f258c150990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f25880119d0 tx=0x7f2588011d90 comp rx=0 tx=0).stop 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f25918c8700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f25700667d0 0x7f2570068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 msgr2=0x7f258c150990 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f2582ffd700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c1ec560 0x7f258c150990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.325 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.321+0000 7f25918c8700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f25700667d0 0x7f2570068c90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f257c0090b0 tx=0x7f257c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 0x7f258c145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258c070400 con 0x7f258c154fe0 2024-09-13T18:08:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25920c9700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 0x7f258c145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25920c9700 1 -- 172.21.15.88:0/909181190 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f258c0c8220 con 0x7f258c154fe0 2024-09-13T18:08:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25920c9700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 0x7f258c145d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f258801b000 tx=0x7f2588004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258801e450 con 0x7f258c154fe0 2024-09-13T18:08:08.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4451 (secure 0 0 0) 0x7f2588029400 con 0x7f258c154fe0 2024-09-13T18:08:08.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 msgr2=0x7f258c145d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 0x7f258c145d60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f258801b000 tx=0x7f2588004770 comp rx=0 tx=0).stop 2024-09-13T18:08:08.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 msgr2=0x7f258c145d60 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f2582ffd700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c154fe0 0x7f258c145d60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:08.339 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.340 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.341 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:08.342 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.343 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.344 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.345 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.346 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.347 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.348 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.349 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.350 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.351 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:08.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f25700667d0 msgr2=0x7f2570068c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f25700667d0 0x7f2570068c90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f257c0090b0 tx=0x7f257c008030 comp rx=0 tx=0).stop 2024-09-13T18:08:08.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 msgr2=0x7f258c145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25928ca700 1 -- 172.21.15.88:0/909181190 reap_dead start 2024-09-13T18:08:08.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f258400caa0 tx=0x7f258400cad0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 shutdown_connections 2024-09-13T18:08:08.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 --2- 172.21.15.88:0/909181190 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f258c153170 0x7f258c145820 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 >> 172.21.15.88:0/909181190 conn(0x7f258c0cb590 msgr2=0x7f258c1590d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 shutdown_connections 2024-09-13T18:08:08.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.333+0000 7f25930cb700 1 -- 172.21.15.88:0/909181190 wait complete. 2024-09-13T18:08:08.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:08.353 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:08:08.353 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:08:08.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 Processor -- start 2024-09-13T18:08:08.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- start start 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff87406c300 0x7ff87406c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff874153490 0x7ff874071710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740c5250 con 0x7ff8740c5e70 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740c5690 con 0x7ff874153490 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740c5870 con 0x7ff87406c300 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff871d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff8740c5e70 0x7ff874152d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54716/0 (socket says 172.21.15.88:54716) 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff871d9b700 1 -- 172.21.15.88:0/777267403 learned_addr learned my addr 172.21.15.88:0/777267403 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:08.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff872d9d700 1 --2- 172.21.15.88:0/777267403 >> v2:172.21.15.88:3300/0 conn(0x7ff874153490 0x7ff874071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 --2- 172.21.15.88:0/777267403 >> v2:172.21.15.94:3300/0 conn(0x7ff87406c300 0x7ff87406c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87159a700 1 -- 172.21.15.88:0/777267403 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538608488 0 0) 0x7ff8740c5250 con 0x7ff8740c5e70 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87159a700 1 -- 172.21.15.88:0/777267403 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c0035d0 con 0x7ff8740c5e70 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 -- 172.21.15.88:0/777267403 >> v2:172.21.15.88:3300/0 conn(0x7ff874153490 msgr2=0x7ff874071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 --2- 172.21.15.88:0/777267403 >> v2:172.21.15.88:3300/0 conn(0x7ff874153490 0x7ff874071710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 -- 172.21.15.88:0/777267403 >> v1:172.21.15.88:6789/0 conn(0x7ff8740c5e70 legacy=0x7ff874152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 -- 172.21.15.88:0/777267403 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87415d0d0 con 0x7ff87406c300 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87259c700 1 --2- 172.21.15.88:0/777267403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87406c300 0x7ff87406c6e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cb730 tx=0x7ff864009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634a86f4569b8c9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87159a700 1 -- 172.21.15.88:0/777267403 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864011830 con 0x7ff87406c300 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87159a700 1 -- 172.21.15.88:0/777267403 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864011990 con 0x7ff87406c300 2024-09-13T18:08:08.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87159a700 1 -- 172.21.15.88:0/777267403 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff864011d20 con 0x7ff87406c300 2024-09-13T18:08:08.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- 172.21.15.88:0/777267403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87406c300 msgr2=0x7ff87406c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 --2- 172.21.15.88:0/777267403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87406c300 0x7ff87406c6e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cb730 tx=0x7ff864009b30 comp rx=0 tx=0).stop 2024-09-13T18:08:08.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- 172.21.15.88:0/777267403 shutdown_connections 2024-09-13T18:08:08.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 --2- 172.21.15.88:0/777267403 >> v2:172.21.15.88:3300/0 conn(0x7ff874153490 0x7ff874071710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 --2- 172.21.15.88:0/777267403 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff87406c300 0x7ff87406c6e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- 172.21.15.88:0/777267403 >> 172.21.15.88:0/777267403 conn(0x7ff8740664b0 msgr2=0x7ff87406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- 172.21.15.88:0/777267403 shutdown_connections 2024-09-13T18:08:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.469+0000 7ff87359e700 1 -- 172.21.15.88:0/777267403 wait complete. 2024-09-13T18:08:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 Processor -- start 2024-09-13T18:08:08.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 -- start start 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff87406c300 0x7ff87414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c5e70 0x7ff874148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740c3490 con 0x7ff874153490 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8741ef940 con 0x7ff8740c5e70 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740c22c0 con 0x7ff87406c300 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39146/0 (socket says 172.21.15.88:39146) 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 -- 172.21.15.88:0/4073856434 learned_addr learned my addr 172.21.15.88:0/4073856434 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87259c700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff87406c300 0x7ff87414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff871d9b700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c5e70 0x7ff874148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff87406c300 msgr2=0x7ff87414c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff87406c300 0x7ff87414c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c5e70 msgr2=0x7ff874148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c5e70 0x7ff874148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.479 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8640094b0 con 0x7ff874153490 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff872d9d700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00efc0 tx=0x7ff86c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c009ea0 con 0x7ff874153490 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00f040 con 0x7ff874153490 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87406cda0 con 0x7ff874153490 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.473+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00ced0 con 0x7ff874153490 2024-09-13T18:08:08.480 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8740c3120 con 0x7ff874153490 2024-09-13T18:08:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff86c014480 con 0x7ff874153490 2024-09-13T18:08:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff87359e700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 0x7ff8740c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874068400 con 0x7ff8741ef400 2024-09-13T18:08:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff87259c700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 0x7ff8740c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff862ffd700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff854066730 0x7ff854068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff86c084900 con 0x7ff874153490 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff871d9b700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff854066730 0x7ff854068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.477+0000 7ff87259c700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8740c5d00 con 0x7ff8741ef400 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff87259c700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 0x7ff8740c3900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cb730 tx=0x7ff864004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86401f070 con 0x7ff8741ef400 2024-09-13T18:08:08.483 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff871d9b700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff854066730 0x7ff854068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8740c74d0 tx=0x7ff868007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7ff864004380 con 0x7ff8741ef400 2024-09-13T18:08:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 msgr2=0x7ff8740c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 0x7ff8740c3900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cb730 tx=0x7ff864004770 comp rx=0 tx=0).stop 2024-09-13T18:08:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 msgr2=0x7ff8740c3900 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.481+0000 7ff862ffd700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8741ef400 0x7ff8740c3900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 0x7ff8740c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740c4380 con 0x7ff8740c2b30 2024-09-13T18:08:08.496 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87259c700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 0x7ff8740c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87259c700 1 -- 172.21.15.88:0/4073856434 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7ff87406cc20 con 0x7ff8740c2b30 2024-09-13T18:08:08.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87259c700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 0x7ff8740c3e40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff874073ed0 tx=0x7ff864011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.497 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86401a830 con 0x7ff8740c2b30 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4947 (secure 0 0 0) 0x7ff864003e90 con 0x7ff8740c2b30 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 msgr2=0x7ff8740c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 0x7ff8740c3e40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff874073ed0 tx=0x7ff864011000 comp rx=0 tx=0).stop 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 msgr2=0x7ff8740c3e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff862ffd700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8740c2b30 0x7ff8740c3e40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.498 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.499 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:08.500 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:08.501 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:08.502 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:08.503 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.504 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:08.505 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.506 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:08.507 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.508 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.509 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.510 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:08.511 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff854066730 msgr2=0x7ff854068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff854066730 0x7ff854068bf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff8740c74d0 tx=0x7ff868007de0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff872d9d700 1 -- 172.21.15.88:0/4073856434 reap_dead start 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 msgr2=0x7ff874149480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00efc0 tx=0x7ff86c00c3a0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 shutdown_connections 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 --2- 172.21.15.88:0/4073856434 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff874153490 0x7ff874149480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 >> 172.21.15.88:0/4073856434 conn(0x7ff8740664b0 msgr2=0x7ff8740c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 shutdown_connections 2024-09-13T18:08:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.493+0000 7ff87359e700 1 -- 172.21.15.88:0/4073856434 wait complete. 2024-09-13T18:08:08.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:08.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:08:08.514 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:08:08.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 Processor -- start 2024-09-13T18:08:08.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 -- start start 2024-09-13T18:08:08.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 0x7f3d4414ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4406ce90 con 0x7f3d4406bfd0 2024-09-13T18:08:08.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4406d170 con 0x7f3d440c1570 2024-09-13T18:08:08.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d49ecb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4406d450 con 0x7f3d44155ba0 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d43fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d496ca700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 0x7f3d4414ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d43fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:48116/0 (socket says 172.21.15.88:48116) 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d43fff700 1 -- 172.21.15.88:0/4248400843 learned_addr learned my addr 172.21.15.88:0/4248400843 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.617+0000 7f3d496ca700 1 --2- 172.21.15.88:0/4248400843 >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 0x7f3d4414ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:56808/0 (socket says 172.21.15.88:56808) 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d43fff700 1 -- 172.21.15.88:0/4248400843 >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 msgr2=0x7f3d4414ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d43fff700 1 --2- 172.21.15.88:0/4248400843 >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 0x7f3d4414ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d43fff700 1 -- 172.21.15.88:0/4248400843 >> v1:172.21.15.94:6789/0 conn(0x7f3d4406bfd0 legacy=0x7f3d4406c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d43fff700 1 -- 172.21.15.88:0/4248400843 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d4406d730 con 0x7f3d44155ba0 2024-09-13T18:08:08.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d43fff700 1 --2- 172.21.15.88:0/4248400843 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009910 tx=0x7f3d34009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e358aa7016dd980 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d437fe700 1 -- 172.21.15.88:0/4248400843 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011830 con 0x7f3d44155ba0 2024-09-13T18:08:08.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d437fe700 1 -- 172.21.15.88:0/4248400843 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d34011990 con 0x7f3d44155ba0 2024-09-13T18:08:08.624 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d437fe700 1 -- 172.21.15.88:0/4248400843 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34011d40 con 0x7f3d44155ba0 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 -- 172.21.15.88:0/4248400843 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 msgr2=0x7f3d4414fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/4248400843 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009910 tx=0x7f3d34009c20 comp rx=0 tx=0).stop 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 -- 172.21.15.88:0/4248400843 shutdown_connections 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/4248400843 >> v2:172.21.15.94:3300/0 conn(0x7f3d440c1570 0x7f3d4414ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/4248400843 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d4414fa40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.625 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 -- 172.21.15.88:0/4248400843 >> 172.21.15.88:0/4248400843 conn(0x7f3d440664b0 msgr2=0x7f3d4406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 -- 172.21.15.88:0/4248400843 shutdown_connections 2024-09-13T18:08:08.626 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.621+0000 7f3d49ecb700 1 -- 172.21.15.88:0/4248400843 wait complete. 2024-09-13T18:08:08.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 Processor -- start 2024-09-13T18:08:08.627 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- start start 2024-09-13T18:08:08.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 0x7f3d440c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c1570 0x7f3d44152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d440c2b70 0x7f3d44148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d441526d0 con 0x7f3d4406bfd0 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440c6bd0 con 0x7f3d440c2b70 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d440c58f0 con 0x7f3d440c1570 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 0x7f3d440c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 0x7f3d440c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39154/0 (socket says 172.21.15.88:39154) 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d43fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c1570 0x7f3d44152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 -- 172.21.15.88:0/1597348154 learned_addr learned my addr 172.21.15.88:0/1597348154 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:08.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d496ca700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d440c2b70 0x7f3d44148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c1570 msgr2=0x7f3d44152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c1570 0x7f3d44152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d440c2b70 msgr2=0x7f3d44148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d440c2b70 0x7f3d44148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d34009570 con 0x7f3d4406bfd0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d48ec9700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 0x7f3d440c6690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00e940 tx=0x7f3d2c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0052d0 con 0x7f3d4406bfd0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2c005430 con 0x7f3d4406bfd0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d440c7080 con 0x7f3d4406bfd0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2c0055a0 con 0x7f3d4406bfd0 2024-09-13T18:08:08.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.625+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d440c5bb0 con 0x7f3d4406bfd0 2024-09-13T18:08:08.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d441492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44068400 con 0x7f3d44155ba0 2024-09-13T18:08:08.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d43fff700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d441492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d43fff700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d4406b6f0 con 0x7f3d44155ba0 2024-09-13T18:08:08.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d43fff700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d441492d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009910 tx=0x7f3d34004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3d2c0038e0 con 0x7f3d4406bfd0 2024-09-13T18:08:08.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3d240666d0 0x7f3d24068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34020070 con 0x7f3d44155ba0 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3d2c086090 con 0x7f3d4406bfd0 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d496ca700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3d240666d0 0x7f3d24068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f3d34004040 con 0x7f3d44155ba0 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 msgr2=0x7f3d441492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d441492d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009910 tx=0x7f3d34004770 comp rx=0 tx=0).stop 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 msgr2=0x7f3d441492d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.629+0000 7f3d417fa700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d44155ba0 0x7f3d441492d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.633+0000 7f3d496ca700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3d240666d0 0x7f3d24068b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d440c1a00 tx=0x7f3d3c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 0x7f3d440c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.645 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d44149810 con 0x7f3d440c5110 2024-09-13T18:08:08.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d43fff700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 0x7f3d440c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d43fff700 1 -- 172.21.15.88:0/1597348154 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f3d4406c3b0 con 0x7f3d440c5110 2024-09-13T18:08:08.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d43fff700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 0x7f3d440c5da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d34000c00 tx=0x7f3d34011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.641+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3402a050 con 0x7f3d440c5110 2024-09-13T18:08:08.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4781 (secure 0 0 0) 0x7f3d3402f070 con 0x7f3d440c5110 2024-09-13T18:08:08.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 msgr2=0x7f3d440c5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d417fa700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 0x7f3d440c5da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d34000c00 tx=0x7f3d34011000 comp rx=0 tx=0).stop 2024-09-13T18:08:08.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d417fa700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 msgr2=0x7f3d440c5da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:08.647 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d417fa700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d440c5110 0x7f3d440c5da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:08.648 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.649 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.650 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.651 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:08.652 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:08.653 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.654 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.655 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.657 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:08.658 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:08.659 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.660 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.661 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.662 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:08.663 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:08:08.664 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:08.664 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:08.664 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:08.664 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:08.664 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:08.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3d240666d0 msgr2=0x7f3d24068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3d240666d0 0x7f3d24068b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3d440c1a00 tx=0x7f3d3c00b040 comp rx=0 tx=0).stop 2024-09-13T18:08:08.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 msgr2=0x7f3d440c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 --2- 172.21.15.88:0/1597348154 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3d4406bfd0 0x7f3d440c6690 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c00e940 tx=0x7f3d2c00ec50 comp rx=0 tx=0).stop 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d496ca700 1 -- 172.21.15.88:0/1597348154 reap_dead start 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d496ca700 1 -- 172.21.15.88:0/1597348154 reap_dead start 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 shutdown_connections 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 >> 172.21.15.88:0/1597348154 conn(0x7f3d440664b0 msgr2=0x7f3d4414f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 shutdown_connections 2024-09-13T18:08:08.666 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.645+0000 7f3d49ecb700 1 -- 172.21.15.88:0/1597348154 wait complete. 2024-09-13T18:08:08.666 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:08.666 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T18:08:08.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T18:08:08.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 Processor -- start 2024-09-13T18:08:08.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 -- start start 2024-09-13T18:08:08.778 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa8b8153080 0x7fa8b806cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8b806e090 0x7fa8b806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b815d330 con 0x7fa8b806db40 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b806d9c0 con 0x7fa8b806e090 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b7fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b806f9e0 con 0x7fa8b8153080 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa8b806e090 0x7fa8b806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.773+0000 7fa8b77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8b806db40 0x7fa8b806fe70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54732/0 (socket says 172.21.15.88:54732) 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b77fe700 1 -- 172.21.15.88:0/90990624 learned_addr learned my addr 172.21.15.88:0/90990624 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:08.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b6ffd700 1 --2- 172.21.15.88:0/90990624 >> v2:172.21.15.94:3300/0 conn(0x7fa8b8153080 0x7fa8b806cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b5ffb700 1 -- 172.21.15.88:0/90990624 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789811836 0 0) 0x7fa8b815d330 con 0x7fa8b806db40 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b5ffb700 1 -- 172.21.15.88:0/90990624 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a00035d0 con 0x7fa8b806db40 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b67fc700 1 -- 172.21.15.88:0/90990624 >> v2:172.21.15.94:3300/0 conn(0x7fa8b8153080 msgr2=0x7fa8b806cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/90990624 >> v2:172.21.15.94:3300/0 conn(0x7fa8b8153080 0x7fa8b806cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b67fc700 1 -- 172.21.15.88:0/90990624 >> v1:172.21.15.88:6789/0 conn(0x7fa8b806db40 legacy=0x7fa8b806fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b67fc700 1 -- 172.21.15.88:0/90990624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b815cdb0 con 0x7fa8b806e090 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/90990624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806e090 0x7fa8b806d1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806c280 tx=0x7fa8a8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf5306f56aa74ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b5ffb700 1 -- 172.21.15.88:0/90990624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011830 con 0x7fa8b806e090 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b5ffb700 1 -- 172.21.15.88:0/90990624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8011990 con 0x7fa8b806e090 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b5ffb700 1 -- 172.21.15.88:0/90990624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8011d00 con 0x7fa8b806e090 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 -- 172.21.15.88:0/90990624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806e090 msgr2=0x7fa8b806d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/90990624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806e090 0x7fa8b806d1e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8b806c280 tx=0x7fa8a8009b30 comp rx=0 tx=0).stop 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 -- 172.21.15.88:0/90990624 shutdown_connections 2024-09-13T18:08:08.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/90990624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806e090 0x7fa8b806d1e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/90990624 >> v2:172.21.15.94:3300/0 conn(0x7fa8b8153080 0x7fa8b806cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 -- 172.21.15.88:0/90990624 >> 172.21.15.88:0/90990624 conn(0x7fa8b80cb7a0 msgr2=0x7fa8b80cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:08.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 -- 172.21.15.88:0/90990624 shutdown_connections 2024-09-13T18:08:08.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.777+0000 7fa8b7fff700 1 -- 172.21.15.88:0/90990624 wait complete. 2024-09-13T18:08:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 Processor -- start 2024-09-13T18:08:08.783 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- start start 2024-09-13T18:08:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 0x7fa8b814c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8b8153080 0x7fa8b814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8159340 con 0x7fa8b806db40 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b81f29d0 con 0x7fa8b806e090 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b81f2f00 con 0x7fa8b8153080 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39180/0 (socket says 172.21.15.88:39180) 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b6ffd700 1 -- 172.21.15.88:0/2257471428 learned_addr learned my addr 172.21.15.88:0/2257471428 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 0x7fa8b814c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b77fe700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8b8153080 0x7fa8b814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 -- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8b8153080 msgr2=0x7fa8b814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8b8153080 0x7fa8b814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 -- 172.21.15.88:0/2257471428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 msgr2=0x7fa8b81551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 -- 172.21.15.88:0/2257471428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80094b0 con 0x7fa8b806e090 2024-09-13T18:08:08.786 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b6ffd700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b67fc700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 0x7fa8b814c630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8016000 tx=0x7fa8a8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80038c0 con 0x7fa8b806e090 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a801f070 con 0x7fa8b806e090 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8b81ef240 con 0x7fa8b806e090 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8003c60 con 0x7fa8b806e090 2024-09-13T18:08:08.787 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.781+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b8155700 con 0x7fa8b806e090 2024-09-13T18:08:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa8a8026480 con 0x7fa8b806e090 2024-09-13T18:08:08.788 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b81ef3d0 con 0x7fa8b806e090 2024-09-13T18:08:08.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa89ffff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 0x7fa8a4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:08.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa8a8021070 con 0x7fa8b806e090 2024-09-13T18:08:08.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa8b6ffd700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 0x7fa8a4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:08.789 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.785+0000 7fa8b6ffd700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 0x7fa8a4068c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0113d0 tx=0x7fa8ac009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:08.799 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:08.797+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa8a8052ec0 con 0x7fa8b806e090 2024-09-13T18:08:09.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.029+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa8b80743b0 con 0x7fa8b806e090 2024-09-13T18:08:09.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.033+0000 7fa89ffff700 1 -- 172.21.15.88:0/2257471428 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa8a8015080 con 0x7fa8b806e090 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 msgr2=0x7fa8a4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 0x7fa8a4068c20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0113d0 tx=0x7fa8ac009240 comp rx=0 tx=0).stop 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 msgr2=0x7fa8b814c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 0x7fa8b814c630 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8016000 tx=0x7fa8a8004770 comp rx=0 tx=0).stop 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 shutdown_connections 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa8a4066760 0x7fa8a4068c20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:09.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8b8153080 0x7fa8b814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:09.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8b806e090 0x7fa8b814c630 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:09.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 --2- 172.21.15.88:0/2257471428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa8b806db40 0x7fa8b81551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:09.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 >> 172.21.15.88:0/2257471428 conn(0x7fa8b80cb7a0 msgr2=0x7fa8b8150040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:09.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 shutdown_connections 2024-09-13T18:08:09.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:09.037+0000 7fa8b7fff700 1 -- 172.21.15.88:0/2257471428 wait complete. 2024-09-13T18:08:09.054 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-13T18:08:11.003 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.004 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.004 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.004 INFO:tasks.workunit.client.0.smithi088.stdout:iozone test complete. 2024-09-13T18:08:11.006 INFO:tasks.workunit.client.0.smithi088.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-13T18:08:11.051 INFO:tasks.workunit.client.0.smithi088.stdout: Iozone: Performance Test of File I/O 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Version $Revision: 3.489 $ 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Compiled for 64 bit mode. 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Build: linux-AMD64 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-13T18:08:11.052 INFO:tasks.workunit.client.0.smithi088.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Run began: Fri Sep 13 18:08:11 2024 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Include close in write timing 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Include fsync in write timing 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: File size set to 10485760 kB 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Record Size 1024 kB 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Output is in kBytes/sec 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Time Resolution = 0.000001 seconds. 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache size set to 1024 kBytes. 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: Processor cache line size set to 32 bytes. 2024-09-13T18:08:11.053 INFO:tasks.workunit.client.0.smithi088.stdout: File stride size set to 17 * record size. 2024-09-13T18:08:11.054 INFO:tasks.workunit.client.0.smithi088.stdout: Throughput test with 1 process 2024-09-13T18:08:11.054 INFO:tasks.workunit.client.0.smithi088.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-13T18:08:19.056 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:08:19.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.180+0000 7fa8858f8700 1 Processor -- start 2024-09-13T18:08:19.185 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.180+0000 7fa8858f8700 1 -- start start 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa88014f6e0 0x7fa880156090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8800c76d0 con 0x7fa8800c5a40 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa880155c00 con 0x7fa88014fac0 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8800c19e0 con 0x7fa88014f6e0 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8850f7700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa8800c5a40 0x7fa88015fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59666/0 (socket says 172.21.15.88:59666) 2024-09-13T18:08:19.187 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87ffff700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fa88014fac0 0x7fa8800c7ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:43132/0 (socket says 172.21.15.88:43132) 2024-09-13T18:08:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8850f7700 1 -- 172.21.15.88:0/4046688419 learned_addr learned my addr 172.21.15.88:0/4046688419 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8848f6700 1 --2- 172.21.15.88:0/4046688419 >> v2:172.21.15.88:3300/0 conn(0x7fa88014f6e0 0x7fa880156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.188 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87f7fe700 1 -- 172.21.15.88:0/4046688419 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199626896 0 0) 0x7fa874001110 con 0x7fa8800c5a40 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87f7fe700 1 -- 172.21.15.88:0/4046688419 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8680035d0 con 0x7fa8800c5a40 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8848f6700 1 -- 172.21.15.88:0/4046688419 >> v1:172.21.15.94:6789/0 conn(0x7fa88014fac0 legacy=0x7fa8800c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8848f6700 1 -- 172.21.15.88:0/4046688419 >> v1:172.21.15.88:6789/0 conn(0x7fa8800c5a40 legacy=0x7fa88015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8848f6700 1 -- 172.21.15.88:0/4046688419 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8800c5fa0 con 0x7fa88014f6e0 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8848f6700 1 --2- 172.21.15.88:0/4046688419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880156090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa878009d90 tx=0x7fa87800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27298bfb94a4d4ab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87f7fe700 1 -- 172.21.15.88:0/4046688419 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800e070 con 0x7fa88014f6e0 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87f7fe700 1 -- 172.21.15.88:0/4046688419 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87800bb20 con 0x7fa88014f6e0 2024-09-13T18:08:19.189 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa87f7fe700 1 -- 172.21.15.88:0/4046688419 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87800be90 con 0x7fa88014f6e0 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- 172.21.15.88:0/4046688419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 msgr2=0x7fa880156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 --2- 172.21.15.88:0/4046688419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880156090 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa878009d90 tx=0x7fa87800b330 comp rx=0 tx=0).stop 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- 172.21.15.88:0/4046688419 shutdown_connections 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 --2- 172.21.15.88:0/4046688419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880156090 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- 172.21.15.88:0/4046688419 >> 172.21.15.88:0/4046688419 conn(0x7fa88006a300 msgr2=0x7fa880070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.190 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- 172.21.15.88:0/4046688419 shutdown_connections 2024-09-13T18:08:19.191 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.184+0000 7fa8858f8700 1 -- 172.21.15.88:0/4046688419 wait complete. 2024-09-13T18:08:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 Processor -- start 2024-09-13T18:08:19.192 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- start start 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8800c5a40 0x7fa8800ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa880152a90 0x7fa8800a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8800aaee0 con 0x7fa88014f6e0 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801520c0 con 0x7fa8800c5a40 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8801ef910 con 0x7fa880152a90 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60052/0 (socket says 172.21.15.88:60052) 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 -- 172.21.15.88:0/799223343 learned_addr learned my addr 172.21.15.88:0/799223343 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:19.194 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 -- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa880152a90 msgr2=0x7fa8800a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa880152a90 0x7fa8800a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 -- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8800c5a40 msgr2=0x7fa8800ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8800c5a40 0x7fa8800ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 -- 172.21.15.88:0/799223343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa878009a70 con 0x7fa88014f6e0 2024-09-13T18:08:19.195 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87ffff700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c730 tx=0x7fa87000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870005cd0 con 0x7fa88014f6e0 2024-09-13T18:08:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870005e30 con 0x7fa88014f6e0 2024-09-13T18:08:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8700072d0 con 0x7fa88014f6e0 2024-09-13T18:08:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88006ce50 con 0x7fa88014f6e0 2024-09-13T18:08:19.196 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.188+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8801514b0 con 0x7fa88014f6e0 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88006e6b0 con 0x7fa88014f6e0 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa870007430 con 0x7fa88014f6e0 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa87d7fa700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 0x7fa86c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa870083570 con 0x7fa88014f6e0 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa8848f6700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 0x7fa86c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.197 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.192+0000 7fa8848f6700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 0x7fa86c068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa878014040 tx=0x7fa878010000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.203 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.200+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa870050910 con 0x7fa88014f6e0 2024-09-13T18:08:19.509 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.504+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fa880152270 con 0x7fa88014f6e0 2024-09-13T18:08:19.510 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.504+0000 7fa87d7fa700 1 -- 172.21.15.88:0/799223343 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fa880152270 con 0x7fa88014f6e0 2024-09-13T18:08:19.510 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 msgr2=0x7fa86c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 0x7fa86c068c20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa878014040 tx=0x7fa878010000 comp rx=0 tx=0).stop 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 msgr2=0x7fa880152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa87000c730 tx=0x7fa87000caf0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 shutdown_connections 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa86c066760 0x7fa86c068c20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa880152a90 0x7fa8800a9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa88014f6e0 0x7fa880152550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 --2- 172.21.15.88:0/799223343 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa8800c5a40 0x7fa8800ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 >> 172.21.15.88:0/799223343 conn(0x7fa88006a300 msgr2=0x7fa8800c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 shutdown_connections 2024-09-13T18:08:19.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.508+0000 7fa8858f8700 1 -- 172.21.15.88:0/799223343 wait complete. 2024-09-13T18:08:19.531 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:08:19.531 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-13T18:08:19.531 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:08:19.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:08:19.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 Processor -- start 2024-09-13T18:08:19.657 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 -- start start 2024-09-13T18:08:19.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf7c0c7800 0x7fcf7c0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.658 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c0c64a0 con 0x7fcf7c0c7420 2024-09-13T18:08:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7c0c41a0 con 0x7fcf7c0c3cb0 2024-09-13T18:08:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.652+0000 7fcf82110700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf7c0c4480 con 0x7fcf7c0c7800 2024-09-13T18:08:19.661 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf7c0c7420 0x7fcf7c0c9240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59678/0 (socket says 172.21.15.88:59678) 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 -- 172.21.15.88:0/3637181002 learned_addr learned my addr 172.21.15.88:0/3637181002 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8090d700 1 --2- 172.21.15.88:0/3637181002 >> v2:172.21.15.88:3300/0 conn(0x7fcf7c0c7800 0x7fcf7c0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 464847028 0 0) 0x7fcf7c0c64a0 con 0x7fcf7c0c7420 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf680035d0 con 0x7fcf7c0c7420 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958640440 0 0) 0x7fcf7c0c41a0 con 0x7fcf7c0c3cb0 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7c0c64a0 con 0x7fcf7c0c3cb0 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2753083947 0 0) 0x7fcf680035d0 con 0x7fcf7c0c7420 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 >> v2:172.21.15.88:3300/0 conn(0x7fcf7c0c7800 msgr2=0x7fcf7c0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:19.662 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 --2- 172.21.15.88:0/3637181002 >> v2:172.21.15.88:3300/0 conn(0x7fcf7c0c7800 0x7fcf7c0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 >> v1:172.21.15.94:6789/0 conn(0x7fcf7c0c3cb0 legacy=0x7fcf7c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0c4760 con 0x7fcf7c0c7420 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fcf78001670 con 0x7fcf7c0c7420 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 >> v1:172.21.15.88:6789/0 conn(0x7fcf7c0c7420 legacy=0x7fcf7c0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf68004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf68004870 0x7fcf68004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf68005230 0x7fcf6800fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c0c4480 con 0x7fcf68003c00 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68007a10 con 0x7fcf68004870 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68007bd0 con 0x7fcf68005230 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8090d700 1 --2- 172.21.15.88:0/3637181002 >> v2:172.21.15.88:3300/0 conn(0x7fcf7c0c7800 0x7fcf7c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf68004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.663 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8090d700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf68004870 0x7fcf68004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8190f700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf68005230 0x7fcf6800fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 -- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf68005230 msgr2=0x7fcf6800fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf68005230 0x7fcf6800fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 -- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf68004870 msgr2=0x7fcf68004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf68004870 0x7fcf68004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 -- 172.21.15.88:0/3637181002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf680035d0 con 0x7fcf68003c00 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8190f700 1 -- 172.21.15.88:0/3637181002 reap_dead start 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8090d700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf68004870 0x7fcf68004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf8110e700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf68004000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c190 tx=0x7fcf680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56579b5dc9d56256 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800ccd0 con 0x7fcf68003c00 2024-09-13T18:08:19.664 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800ce50 con 0x7fcf68003c00 2024-09-13T18:08:19.665 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf73fff700 1 -- 172.21.15.88:0/3637181002 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78005bc0 con 0x7fcf68003c00 2024-09-13T18:08:19.667 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf82110700 1 -- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 msgr2=0x7fcf68004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf82110700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf68004000 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800c190 tx=0x7fcf680058a0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf82110700 1 -- 172.21.15.88:0/3637181002 shutdown_connections 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf82110700 1 --2- 172.21.15.88:0/3637181002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf68004000 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.656+0000 7fcf82110700 1 -- 172.21.15.88:0/3637181002 >> 172.21.15.88:0/3637181002 conn(0x7fcf7c066090 msgr2=0x7fcf7c0664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- 172.21.15.88:0/3637181002 shutdown_connections 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- 172.21.15.88:0/3637181002 wait complete. 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 Processor -- start 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- start start 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf7c13af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf7c13ff80 0x7fcf7c149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf7c14a1b0 0x7fcf7c143ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.668 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c14a640 con 0x7fcf68003c00 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c13b460 con 0x7fcf7c13ff80 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf82110700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c071f60 con 0x7fcf7c14a1b0 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf7c13af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf7c13af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60068/0 (socket says 172.21.15.88:60068) 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 -- 172.21.15.88:0/1831849121 learned_addr learned my addr 172.21.15.88:0/1831849121 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8090d700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf7c13ff80 0x7fcf7c149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8190f700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf7c14a1b0 0x7fcf7c143ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf7c14a1b0 msgr2=0x7fcf7c143ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf7c14a1b0 0x7fcf7c143ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf7c13ff80 msgr2=0x7fcf7c149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf7c13ff80 0x7fcf7c149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8110e700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c070150 con 0x7fcf68003c00 2024-09-13T18:08:19.669 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.660+0000 7fcf8190f700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf7c14a1b0 0x7fcf7c143ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf8110e700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf7c13af20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf68010430 tx=0x7fcf7c0c6410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780072d0 con 0x7fcf68003c00 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c070430 con 0x7fcf68003c00 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7c0709f0 con 0x7fcf68003c00 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78005e90 con 0x7fcf68003c00 2024-09-13T18:08:19.670 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78007a90 con 0x7fcf68003c00 2024-09-13T18:08:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf82110700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 0x7fcf5c004f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c007f40 con 0x7fcf5c002a40 2024-09-13T18:08:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf8090d700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 0x7fcf5c004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf78007630 con 0x7fcf68003c00 2024-09-13T18:08:19.671 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf8090d700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf5c008100 con 0x7fcf5c002a40 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf8090d700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 0x7fcf5c004f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c07ab60 tx=0x7fcf6c013c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf60066760 0x7fcf60068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcf780853d0 con 0x7fcf68003c00 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c004230 con 0x7fcf5c002a40 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fcf6c004390 con 0x7fcf5c002a40 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 msgr2=0x7fcf5c004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 0x7fcf5c004f00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c07ab60 tx=0x7fcf6c013c10 comp rx=0 tx=0).stop 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 msgr2=0x7fcf5c004f00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf71ffb700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c002a40 0x7fcf5c004f00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.672 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.664+0000 7fcf8190f700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf60066760 0x7fcf60068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.668+0000 7fcf8190f700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf60066760 0x7fcf60068c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0c9de0 tx=0x7fcf74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf82110700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 0x7fcf5c007440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c00a400 con 0x7fcf5c006fd0 2024-09-13T18:08:19.679 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf8090d700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 0x7fcf5c007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf8090d700 1 -- 172.21.15.88:0/1831849121 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fcf5c00a5c0 con 0x7fcf5c006fd0 2024-09-13T18:08:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf8090d700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 0x7fcf5c007440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c07ab60 tx=0x7fcf6c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.680 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c003b10 con 0x7fcf5c006fd0 2024-09-13T18:08:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4452 (secure 0 0 0) 0x7fcf6c003c70 con 0x7fcf5c006fd0 2024-09-13T18:08:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 msgr2=0x7fcf5c007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 0x7fcf5c007440 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c07ab60 tx=0x7fcf6c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 msgr2=0x7fcf5c007440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:19.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.676+0000 7fcf71ffb700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf5c006fd0 0x7fcf5c007440 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:08:19.683 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.684 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.685 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:19.686 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:19.687 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:19.688 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.689 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.690 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.691 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:19.692 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:19.692 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.692 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.692 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.692 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.693 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.694 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.695 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.696 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.696 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:19.696 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf60066760 msgr2=0x7fcf60068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf60066760 0x7fcf60068c20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0c9de0 tx=0x7fcf74009040 comp rx=0 tx=0).stop 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 msgr2=0x7fcf7c13af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 --2- 172.21.15.88:0/1831849121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf68003c00 0x7fcf7c13af20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcf68010430 tx=0x7fcf7c0c6410 comp rx=0 tx=0).stop 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf8190f700 1 -- 172.21.15.88:0/1831849121 reap_dead start 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf8190f700 1 -- 172.21.15.88:0/1831849121 reap_dead start 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 shutdown_connections 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 >> 172.21.15.88:0/1831849121 conn(0x7fcf7c066090 msgr2=0x7fcf7c0c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.697 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 shutdown_connections 2024-09-13T18:08:19.698 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.680+0000 7fcf82110700 1 -- 172.21.15.88:0/1831849121 wait complete. 2024-09-13T18:08:19.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:19.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:08:19.705 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:08:19.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 Processor -- start 2024-09-13T18:08:19.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 -- start start 2024-09-13T18:08:19.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97a80c4e90 0x7f97a80c7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a815a1c0 0x7f97a815a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.842 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a80c78c0 con 0x7f97a80bff80 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80c5270 con 0x7f97a815a1c0 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97ace65700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a80c0710 con 0x7f97a80c4e90 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a815a1c0 0x7f97a815a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97a815a1c0 0x7f97a815a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60094/0 (socket says 172.21.15.88:60094) 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 -- 172.21.15.88:0/1069995921 learned_addr learned my addr 172.21.15.88:0/1069995921 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:19.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1069995921 >> v2:172.21.15.94:3300/0 conn(0x7f97a80c4e90 0x7f97a80c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 -- 172.21.15.88:0/1069995921 >> v2:172.21.15.94:3300/0 conn(0x7f97a80c4e90 msgr2=0x7f97a80c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 --2- 172.21.15.88:0/1069995921 >> v2:172.21.15.94:3300/0 conn(0x7f97a80c4e90 0x7f97a80c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 -- 172.21.15.88:0/1069995921 >> v1:172.21.15.94:6789/0 conn(0x7f97a80bff80 legacy=0x7f97a80710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.836+0000 7f97a7fff700 1 -- 172.21.15.88:0/1069995921 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a815ab70 con 0x7f97a815a1c0 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97a7fff700 1 --2- 172.21.15.88:0/1069995921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a815a630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97a8071b40 tx=0x7f97a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de46dcb783712808 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97a6ffd700 1 -- 172.21.15.88:0/1069995921 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000e070 con 0x7f97a815a1c0 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97a6ffd700 1 -- 172.21.15.88:0/1069995921 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a000b910 con 0x7f97a815a1c0 2024-09-13T18:08:19.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97a6ffd700 1 -- 172.21.15.88:0/1069995921 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a000bcc0 con 0x7f97a815a1c0 2024-09-13T18:08:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97ace65700 1 -- 172.21.15.88:0/1069995921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 msgr2=0x7f97a815a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.840+0000 7f97ace65700 1 --2- 172.21.15.88:0/1069995921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a815a630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97a8071b40 tx=0x7f97a000b330 comp rx=0 tx=0).stop 2024-09-13T18:08:19.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 -- 172.21.15.88:0/1069995921 shutdown_connections 2024-09-13T18:08:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 --2- 172.21.15.88:0/1069995921 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a815a630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 --2- 172.21.15.88:0/1069995921 >> v2:172.21.15.94:3300/0 conn(0x7f97a80c4e90 0x7f97a80c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 -- 172.21.15.88:0/1069995921 >> 172.21.15.88:0/1069995921 conn(0x7f97a80cb590 msgr2=0x7f97a80c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 -- 172.21.15.88:0/1069995921 shutdown_connections 2024-09-13T18:08:19.850 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.844+0000 7f97ace65700 1 -- 172.21.15.88:0/1069995921 wait complete. 2024-09-13T18:08:19.851 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 Processor -- start 2024-09-13T18:08:19.852 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 -- start start 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97a80bff80 0x7f97a80c6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c4e90 0x7f97a8151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a814deb0 con 0x7f97a815a1c0 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a80c3fe0 con 0x7f97a80c4e90 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97ace65700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a81525f0 con 0x7f97a80bff80 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97a7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60110/0 (socket says 172.21.15.88:60110) 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97a7fff700 1 -- 172.21.15.88:0/1709152160 learned_addr learned my addr 172.21.15.88:0/1709152160 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97a80bff80 0x7f97a80c6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.848+0000 7f979ffff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c4e90 0x7f97a8151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97a80bff80 msgr2=0x7f97a80c6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97a80bff80 0x7f97a80c6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c4e90 msgr2=0x7f97a8151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c4e90 0x7f97a8151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009b30 con 0x7f97a815a1c0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a7fff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97a80668f0 tx=0x7f97a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0004880 con 0x7f97a815a1c0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00099b0 con 0x7f97a815a1c0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a001b670 con 0x7f97a815a1c0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a81528d0 con 0x7f97a815a1c0 2024-09-13T18:08:19.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a80c73f0 con 0x7f97a815a1c0 2024-09-13T18:08:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97ace65700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 0x7f97a814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8068400 con 0x7f97a80c3b10 2024-09-13T18:08:19.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 0x7f97a814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f97a001b7d0 con 0x7f97a815a1c0 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a77fe700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f97a8156f90 con 0x7f97a80c3b10 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 0x7f97a814e840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97980119d0 tx=0x7f9798011d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9788066760 0x7f9788068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f97a0085610 con 0x7f97a815a1c0 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9798004240 con 0x7f97a80c3b10 2024-09-13T18:08:19.859 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.852+0000 7f979ffff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9788066760 0x7f9788068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f97980043a0 con 0x7f97a80c3b10 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 msgr2=0x7f97a814e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f97a4ff9700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 0x7f97a814e840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97980119d0 tx=0x7f9798011d90 comp rx=0 tx=0).stop 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 msgr2=0x7f97a814e840 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f97a4ff9700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a80c3b10 0x7f97a814e840 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97980119d0 tx=0x7f9798011d90 comp rx=0 tx=0).stop 2024-09-13T18:08:19.860 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.856+0000 7f979ffff700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9788066760 0x7f9788068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c3020 tx=0x7f9790009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 0x7f97a814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:19.871 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a8152a60 con 0x7f97a814d030 2024-09-13T18:08:19.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 0x7f97a814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:19.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a77fe700 1 -- 172.21.15.88:0/1709152160 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f97a8156cf0 con 0x7f97a814d030 2024-09-13T18:08:19.872 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a77fe700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 0x7f97a814d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f979801b000 tx=0x7f9798004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:19.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979801e450 con 0x7f97a814d030 2024-09-13T18:08:19.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4948 (secure 0 0 0) 0x7f97980283a0 con 0x7f97a814d030 2024-09-13T18:08:19.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 msgr2=0x7f97a814d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.873 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 0x7f97a814d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f979801b000 tx=0x7f9798004770 comp rx=0 tx=0).stop 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 msgr2=0x7f97a814d440 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a4ff9700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97a814d030 0x7f97a814d440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:19.874 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.875 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.876 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:19.877 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.878 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.879 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:19.880 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:19.881 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:19.882 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:19.883 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:19.884 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.885 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.886 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:19.887 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.888 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:19.889 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.890 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.891 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:19.892 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:19.893 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:19.894 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:19.895 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:19.896 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:19.897 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:19.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9788066760 msgr2=0x7f9788068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9788066760 0x7f9788068c20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f97a80c3020 tx=0x7f9790009040 comp rx=0 tx=0).stop 2024-09-13T18:08:19.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 msgr2=0x7f97a814e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:19.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f97a80668f0 tx=0x7f97a0004af0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97a7fff700 1 -- 172.21.15.88:0/1709152160 reap_dead start 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 shutdown_connections 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 --2- 172.21.15.88:0/1709152160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97a815a1c0 0x7f97a814e300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 >> 172.21.15.88:0/1709152160 conn(0x7f97a80cb590 msgr2=0x7f97a80c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 shutdown_connections 2024-09-13T18:08:19.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:19.868+0000 7f97ace65700 1 -- 172.21.15.88:0/1709152160 wait complete. 2024-09-13T18:08:19.899 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:19.899 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:08:19.899 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:08:20.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.024+0000 7fbcf67e0700 1 Processor -- start 2024-09-13T18:08:20.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.024+0000 7fbcf67e0700 1 -- start start 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.024+0000 7fbcf67e0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01500d0 0x7fbcf006d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.024+0000 7fbcf67e0700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbcf00c25a0 0x7fbcf006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf006de60 con 0x7fbcf006d0e0 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00c31f0 con 0x7fbcf01500d0 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf0156210 con 0x7fbcf00c25a0 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01500d0 0x7fbcf006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbcf01500d0 0x7fbcf006d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60112/0 (socket says 172.21.15.88:60112) 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 -- 172.21.15.88:0/3895439707 learned_addr learned my addr 172.21.15.88:0/3895439707 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcef7fe700 1 --2- 172.21.15.88:0/3895439707 >> v2:172.21.15.94:3300/0 conn(0x7fbcf00c25a0 0x7fbcf006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 -- 172.21.15.88:0/3895439707 >> v2:172.21.15.94:3300/0 conn(0x7fbcf00c25a0 msgr2=0x7fbcf006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 --2- 172.21.15.88:0/3895439707 >> v2:172.21.15.94:3300/0 conn(0x7fbcf00c25a0 0x7fbcf006cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 -- 172.21.15.88:0/3895439707 >> v1:172.21.15.94:6789/0 conn(0x7fbcf006d0e0 legacy=0x7fbcf0159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 -- 172.21.15.88:0/3895439707 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf01564f0 con 0x7fbcf01500d0 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceffff700 1 --2- 172.21.15.88:0/3895439707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf01500d0 0x7fbcf006d920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0066af0 tx=0x7fbce4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f876aee40dd10ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceeffd700 1 -- 172.21.15.88:0/3895439707 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4004230 con 0x7fbcf01500d0 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceeffd700 1 -- 172.21.15.88:0/3895439707 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4004390 con 0x7fbcf01500d0 2024-09-13T18:08:20.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbceeffd700 1 -- 172.21.15.88:0/3895439707 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40036c0 con 0x7fbcf01500d0 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- 172.21.15.88:0/3895439707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf01500d0 msgr2=0x7fbcf006d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/3895439707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf01500d0 0x7fbcf006d920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0066af0 tx=0x7fbce4009bf0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- 172.21.15.88:0/3895439707 shutdown_connections 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/3895439707 >> v2:172.21.15.94:3300/0 conn(0x7fbcf00c25a0 0x7fbcf006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/3895439707 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf01500d0 0x7fbcf006d920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- 172.21.15.88:0/3895439707 >> 172.21.15.88:0/3895439707 conn(0x7fbcf0066090 msgr2=0x7fbcf0071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- 172.21.15.88:0/3895439707 shutdown_connections 2024-09-13T18:08:20.034 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- 172.21.15.88:0/3895439707 wait complete. 2024-09-13T18:08:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 Processor -- start 2024-09-13T18:08:20.035 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.028+0000 7fbcf67e0700 1 -- start start 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf006d0e0 0x7fbcf014ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf01500d0 0x7fbcf0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf01ec670 con 0x7fbcf00c25a0 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf01528a0 con 0x7fbcf01500d0 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf00c9a80 con 0x7fbcf006d0e0 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60120/0 (socket says 172.21.15.88:60120) 2024-09-13T18:08:20.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 -- 172.21.15.88:0/1834419742 learned_addr learned my addr 172.21.15.88:0/1834419742 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:20.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf006d0e0 msgr2=0x7fbcf014ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf006d0e0 0x7fbcf014ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf01500d0 msgr2=0x7fbcf0150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf4d7d700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf01500d0 0x7fbcf0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf01500d0 0x7fbcf0150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009570 con 0x7fbcf00c25a0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf4d7d700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbcf01500d0 0x7fbcf0150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcef7fe700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbce000ebe0 tx=0x7fbce0009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0009740 con 0x7fbcf00c25a0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce000c8b0 con 0x7fbcf00c25a0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf0152c50 con 0x7fbcf00c25a0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce000cc40 con 0x7fbcf00c25a0 2024-09-13T18:08:20.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.032+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf01531d0 con 0x7fbcf00c25a0 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 0x7fbcf014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0067ae0 con 0x7fbcf01ebfb0 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fbce0013470 con 0x7fbcf00c25a0 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbceffff700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 0x7fbcf014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbcdc068940 0x7fbcdc06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbce0084730 con 0x7fbcf00c25a0 2024-09-13T18:08:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcf4d7d700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbcdc068940 0x7fbcdc06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbceffff700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcf006d960 con 0x7fbcf01ebfb0 2024-09-13T18:08:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbceffff700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 0x7fbcf014c000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbce4004700 tx=0x7fbce40039a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcf4d7d700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbcdc068940 0x7fbcdc06ae00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0158e90 tx=0x7fbce8007340 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.041 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4003b40 con 0x7fbcf01ebfb0 2024-09-13T18:08:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7fbce401f070 con 0x7fbcf01ebfb0 2024-09-13T18:08:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 msgr2=0x7fbcf014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 0x7fbcf014c000 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbce4004700 tx=0x7fbce40039a0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 msgr2=0x7fbcf014c000 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:20.042 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.036+0000 7fbcecff9700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ebfb0 0x7fbcf014c000 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbce4004700 tx=0x7fbce40039a0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.044+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 0x7fbcf01ef930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.044+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf01594f0 con 0x7fbcf01ef520 2024-09-13T18:08:20.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbceffff700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 0x7fbcf01ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbceffff700 1 -- 172.21.15.88:0/1834419742 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7fbcf0156ab0 con 0x7fbcf01ef520 2024-09-13T18:08:20.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbceffff700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 0x7fbcf01ef930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0067240 tx=0x7fbce4011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4011de0 con 0x7fbcf01ef520 2024-09-13T18:08:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4782 (secure 0 0 0) 0x7fbce402a620 con 0x7fbcf01ef520 2024-09-13T18:08:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 msgr2=0x7fbcf01ef930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 0x7fbcf01ef930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0067240 tx=0x7fbce4011000 comp rx=0 tx=0).stop 2024-09-13T18:08:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 msgr2=0x7fbcf01ef930 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:20.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcecff9700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbcf01ef520 0x7fbcf01ef930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.055 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:20.055 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:20.056 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:20.056 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:08:20.056 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 28, 2024-09-13T18:08:20.056 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:20.057 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:20.057 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:08:20.057 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:08:20.057 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.058 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 11, 2024-09-13T18:08:20.058 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:20.058 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:20.058 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:20.059 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:20.059 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:20.059 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:20.059 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:20.060 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:20.060 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:20.060 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:20.060 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:20.060 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:20.061 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:20.061 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.061 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:20.061 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:20.062 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:20.062 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:20.062 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:20.062 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:20.063 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:20.063 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:20.063 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:20.063 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:20.064 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:20.064 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:20.064 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.064 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.064 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:20.065 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:20.065 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:20.065 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:20.065 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:20.066 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:20.066 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:20.066 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:20.066 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:20.066 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:20.067 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:20.067 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:20.067 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:20.067 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:20.068 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:20.068 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:20.068 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:20.068 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:20.069 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:20.069 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:20.069 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:20.069 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:20.070 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:20.070 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:20.070 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:20.070 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:20.070 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:20.071 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.071 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:20.071 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.071 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:20.072 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.072 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:20.072 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:20.072 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:20.072 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:20.073 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.073 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:20.073 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:20.073 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.074 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.074 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.074 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:20.074 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:20.074 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.075 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.075 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.075 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.075 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:20.075 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:20.076 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:20.076 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:20.076 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:20.076 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.076 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.077 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:20.077 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:20.077 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:20.077 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:20.077 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:20.084 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.085 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:20.086 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.087 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 6 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.088 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:08:20.089 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:20.090 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:20.090 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:20.090 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:20.090 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbcdc068940 msgr2=0x7fbcdc06ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fbcdc068940 0x7fbcdc06ae00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbcf0158e90 tx=0x7fbce8007340 comp rx=0 tx=0).stop 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 msgr2=0x7fbcf01ecb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbce000ebe0 tx=0x7fbce0009e00 comp rx=0 tx=0).stop 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf4d7d700 1 -- 172.21.15.88:0/1834419742 reap_dead start 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 shutdown_connections 2024-09-13T18:08:20.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 --2- 172.21.15.88:0/1834419742 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbcf00c25a0 0x7fbcf01ecb00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 >> 172.21.15.88:0/1834419742 conn(0x7fbcf0066090 msgr2=0x7fbcf00c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 shutdown_connections 2024-09-13T18:08:20.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.048+0000 7fbcf67e0700 1 -- 172.21.15.88:0/1834419742 wait complete. 2024-09-13T18:08:20.093 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:08:20.093 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2024-09-13T18:08:20.093 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-13T18:08:20.093 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-13T18:08:20.093 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-13T18:08:20.094 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:08:20.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:08:20.134 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:08:20.134 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2024-09-13T18:08:20.135 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:20.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.260+0000 7fdc3605d700 1 Processor -- start 2024-09-13T18:08:20.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.260+0000 7fdc3605d700 1 -- start start 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3605d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc3006bc30 0x7fdc300c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3605d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc300c3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3605d700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc300c4ae0 con 0x7fdc300c85b0 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3605d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc300c8190 con 0x7fdc3006bc30 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3605d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc300c3f60 con 0x7fdc3006c010 2024-09-13T18:08:20.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3505b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc3006bc30 0x7fdc300c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3505b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc3006bc30 0x7fdc300c73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60154/0 (socket says 172.21.15.88:60154) 2024-09-13T18:08:20.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.264+0000 7fdc3505b700 1 -- 172.21.15.88:0/520272058 learned_addr learned my addr 172.21.15.88:0/520272058 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3485a700 1 -- 172.21.15.88:0/520272058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 msgr2=0x7fdc300c3590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:20.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3485a700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc300c3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3505b700 1 -- 172.21.15.88:0/520272058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 msgr2=0x7fdc300c3590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:08:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3505b700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc300c3590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3505b700 1 -- 172.21.15.88:0/520272058 >> v1:172.21.15.94:6789/0 conn(0x7fdc300c85b0 legacy=0x7fdc30150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3505b700 1 -- 172.21.15.88:0/520272058 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc300c4240 con 0x7fdc3006bc30 2024-09-13T18:08:20.272 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3505b700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc300c73c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009910 tx=0x7fdc2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3697def37f36f7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc27fff700 1 -- 172.21.15.88:0/520272058 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c00ba60 con 0x7fdc3006bc30 2024-09-13T18:08:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc27fff700 1 -- 172.21.15.88:0/520272058 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00bbc0 con 0x7fdc3006bc30 2024-09-13T18:08:20.273 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc27fff700 1 -- 172.21.15.88:0/520272058 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c009e60 con 0x7fdc3006bc30 2024-09-13T18:08:20.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 -- 172.21.15.88:0/520272058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 msgr2=0x7fdc300c73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc300c73c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c009910 tx=0x7fdc2c009c20 comp rx=0 tx=0).stop 2024-09-13T18:08:20.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 -- 172.21.15.88:0/520272058 shutdown_connections 2024-09-13T18:08:20.274 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc300c3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 --2- 172.21.15.88:0/520272058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc300c73c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 -- 172.21.15.88:0/520272058 >> 172.21.15.88:0/520272058 conn(0x7fdc3006f4d0 msgr2=0x7fdc3006da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 -- 172.21.15.88:0/520272058 shutdown_connections 2024-09-13T18:08:20.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.268+0000 7fdc3605d700 1 -- 172.21.15.88:0/520272058 wait complete. 2024-09-13T18:08:20.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 Processor -- start 2024-09-13T18:08:20.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- start start 2024-09-13T18:08:20.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc301eae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 0x7fdc3014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.281 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3014ab60 con 0x7fdc3006bc30 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc301ea980 con 0x7fdc300c85b0 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc30071fb0 con 0x7fdc3006c010 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60162/0 (socket says 172.21.15.88:60162) 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 -- 172.21.15.88:0/3656100512 learned_addr learned my addr 172.21.15.88:0/3656100512 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:20.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3485a700 1 -- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 msgr2=0x7fdc301eae10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3485a700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc301eae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 -- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 msgr2=0x7fdc301eae10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3585c700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 0x7fdc3014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc301eae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 -- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 msgr2=0x7fdc3014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 0x7fdc3014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 -- 172.21.15.88:0/3656100512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c009570 con 0x7fdc3006bc30 2024-09-13T18:08:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3585c700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 0x7fdc3014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:08:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3505b700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc30072ae0 tx=0x7fdc2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c004310 con 0x7fdc3006bc30 2024-09-13T18:08:20.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2c01f070 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc301ea350 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c0036c0 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.272+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc30148190 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc300c70b0 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdc2c021030 con 0x7fdc3006bc30 2024-09-13T18:08:20.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc25ffb700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 0x7fdc14068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdc2c0855e0 con 0x7fdc3006bc30 2024-09-13T18:08:20.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc3485a700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 0x7fdc14068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.276+0000 7fdc3485a700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 0x7fdc14068bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014f960 tx=0x7fdc20009270 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:20.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.280+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdc2c052960 con 0x7fdc3006bc30 2024-09-13T18:08:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.596+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fdc300c89e0 con 0x7fdc3006bc30 2024-09-13T18:08:20.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.600+0000 7fdc25ffb700 1 -- 172.21.15.88:0/3656100512 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fdc2c055f80 con 0x7fdc3006bc30 2024-09-13T18:08:20.604 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":12,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 msgr2=0x7fdc14068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 0x7fdc14068bd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdc3014f960 tx=0x7fdc20009270 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 msgr2=0x7fdc301ed8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fdc30072ae0 tx=0x7fdc2c004770 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 shutdown_connections 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdc14066710 0x7fdc14068bd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdc3006c010 0x7fdc301eae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdc300c85b0 0x7fdc3014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 --2- 172.21.15.88:0/3656100512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc3006bc30 0x7fdc301ed8c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 >> 172.21.15.88:0/3656100512 conn(0x7fdc3006f4d0 msgr2=0x7fdc3014feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 shutdown_connections 2024-09-13T18:08:20.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:20.604+0000 7fdc3605d700 1 -- 172.21.15.88:0/3656100512 wait complete. 2024-09-13T18:08:23.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:23.770 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.764+0000 7f0b8dc78700 1 Processor -- start 2024-09-13T18:08:23.771 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.764+0000 7f0b8dc78700 1 -- start start 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b8815a820 0x7f0b880c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b88157760 con 0x7f0b88150aa0 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b88156b70 con 0x7f0b88071330 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b880c38f0 con 0x7f0b8815a820 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b8815a820 0x7f0b880c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0b8815a820 0x7f0b880c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37414/0 (socket says 172.21.15.88:37414) 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 -- 172.21.15.88:0/1625154227 learned_addr learned my addr 172.21.15.88:0/1625154227 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 -- 172.21.15.88:0/1625154227 >> v1:172.21.15.94:6789/0 conn(0x7f0b88071330 legacy=0x7f0b880c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 -- 172.21.15.88:0/1625154227 >> v1:172.21.15.88:6789/0 conn(0x7f0b88150aa0 legacy=0x7f0b8815a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 -- 172.21.15.88:0/1625154227 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b880c2830 con 0x7f0b8815a820 2024-09-13T18:08:23.773 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8d477700 1 --2- 172.21.15.88:0/1625154227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b8815a820 0x7f0b880c33b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009e50 tx=0x7f0b8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796da69635f686f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b877fe700 1 -- 172.21.15.88:0/1625154227 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000e070 con 0x7f0b8815a820 2024-09-13T18:08:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b877fe700 1 -- 172.21.15.88:0/1625154227 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8000b9c0 con 0x7f0b8815a820 2024-09-13T18:08:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b877fe700 1 -- 172.21.15.88:0/1625154227 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8000bd70 con 0x7f0b8815a820 2024-09-13T18:08:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 -- 172.21.15.88:0/1625154227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b8815a820 msgr2=0x7f0b880c33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:23.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.768+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/1625154227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b8815a820 0x7f0b880c33b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009e50 tx=0x7f0b8000b330 comp rx=0 tx=0).stop 2024-09-13T18:08:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 -- 172.21.15.88:0/1625154227 shutdown_connections 2024-09-13T18:08:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/1625154227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b8815a820 0x7f0b880c33b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:23.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 -- 172.21.15.88:0/1625154227 >> 172.21.15.88:0/1625154227 conn(0x7f0b880cb7a0 msgr2=0x7f0b880cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:23.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 -- 172.21.15.88:0/1625154227 shutdown_connections 2024-09-13T18:08:23.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 -- 172.21.15.88:0/1625154227 wait complete. 2024-09-13T18:08:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 Processor -- start 2024-09-13T18:08:23.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 -- start start 2024-09-13T18:08:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.772+0000 7f0b8dc78700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b88150aa0 0x7f0b88159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:23.779 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 0x7f0b8806d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8815a4a0 con 0x7f0b88150aa0 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8806e900 con 0x7f0b88071330 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b881501d0 con 0x7f0b8815a820 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8d477700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 msgr2=0x7f0b8806d8f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8d477700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 0x7f0b8806d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:39528/0 (socket says 172.21.15.88:39528) 2024-09-13T18:08:23.780 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 -- 172.21.15.88:0/3764328274 learned_addr learned my addr 172.21.15.88:0/3764328274 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 -- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 msgr2=0x7f0b8806d8f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 0x7f0b8806d8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 -- 172.21.15.88:0/3764328274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b88150aa0 msgr2=0x7f0b88159900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b88150aa0 0x7f0b88159900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:23.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 -- 172.21.15.88:0/3764328274 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80009b30 con 0x7f0b88071330 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8cc76700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c6e0 tx=0x7f0b7c00caa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0052d0 con 0x7f0b88071330 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7c005450 con 0x7f0b88071330 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7c0038e0 con 0x7f0b88071330 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b881392d0 con 0x7f0b88071330 2024-09-13T18:08:23.784 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b881386c0 con 0x7f0b88071330 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.776+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b88150e80 con 0x7f0b88071330 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.780+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0b7c003a40 con 0x7f0b88071330 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.780+0000 7f0b857fa700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 0x7f0b6c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.780+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0b7c083ab0 con 0x7f0b88071330 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.780+0000 7f0b87fff700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 0x7f0b6c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:23.785 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.780+0000 7f0b87fff700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 0x7f0b6c068bd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b881588f0 tx=0x7f0b74007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:23.795 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:23.792+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0b7c050e10 con 0x7f0b88071330 2024-09-13T18:08:24.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.072+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f0b8806f980 con 0x7f0b88071330 2024-09-13T18:08:24.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.072+0000 7f0b857fa700 1 -- 172.21.15.88:0/3764328274 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f0b7c017080 con 0x7f0b88071330 2024-09-13T18:08:24.076 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":15,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.072+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 msgr2=0x7f0b6c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.072+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 0x7f0b6c068bd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0b881588f0 tx=0x7f0b74007a80 comp rx=0 tx=0).stop 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 msgr2=0x7f0b88138d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00c6e0 tx=0x7f0b7c00caa0 comp rx=0 tx=0).stop 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 shutdown_connections 2024-09-13T18:08:24.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0b6c066710 0x7f0b6c068bd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b8815a820 0x7f0b8806d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0b88150aa0 0x7f0b88159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 --2- 172.21.15.88:0/3764328274 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b88071330 0x7f0b88138d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 >> 172.21.15.88:0/3764328274 conn(0x7f0b880cb7a0 msgr2=0x7f0b880c6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 shutdown_connections 2024-09-13T18:08:24.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:24.076+0000 7f0b8dc78700 1 -- 172.21.15.88:0/3764328274 wait complete. 2024-09-13T18:08:27.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:27.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.224+0000 7fd409074700 1 Processor -- start 2024-09-13T18:08:27.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.224+0000 7fd409074700 1 -- start start 2024-09-13T18:08:27.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd4040c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd404071720 0x7fd404071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040c18f0 con 0x7fd40414fdb0 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd404159520 con 0x7fd404071720 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4041560a0 con 0x7fd404159100 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd4037fe700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 msgr2=0x7fd4040c1c90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd4037fe700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd4040c1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:27.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd404071720 0x7fd404071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd404071720 0x7fd404071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37420/0 (socket says 172.21.15.88:37420) 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 -- 172.21.15.88:0/3029287442 learned_addr learned my addr 172.21.15.88:0/3029287442 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd403fff700 1 --1- 172.21.15.88:0/3029287442 >> v1:172.21.15.94:6789/0 conn(0x7fd40414fdb0 0x7fd404156530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:44926/0 (socket says 172.21.15.88:44926) 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 -- 172.21.15.88:0/3029287442 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 msgr2=0x7fd4040c1c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 --2- 172.21.15.88:0/3029287442 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd4040c1c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 -- 172.21.15.88:0/3029287442 >> v1:172.21.15.94:6789/0 conn(0x7fd40414fdb0 legacy=0x7fd404156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 -- 172.21.15.88:0/3029287442 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404159fe0 con 0x7fd404071720 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd408873700 1 --2- 172.21.15.88:0/3029287442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd404071bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d150 tx=0x7fd3fc00d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5f18c16729f547 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd402ffd700 1 -- 172.21.15.88:0/3029287442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc010070 con 0x7fd404071720 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd402ffd700 1 -- 172.21.15.88:0/3029287442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00ddc0 con 0x7fd404071720 2024-09-13T18:08:27.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd402ffd700 1 -- 172.21.15.88:0/3029287442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00b310 con 0x7fd404071720 2024-09-13T18:08:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- 172.21.15.88:0/3029287442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 msgr2=0x7fd404071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 --2- 172.21.15.88:0/3029287442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd404071bb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d150 tx=0x7fd3fc00d460 comp rx=0 tx=0).stop 2024-09-13T18:08:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- 172.21.15.88:0/3029287442 shutdown_connections 2024-09-13T18:08:27.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 --2- 172.21.15.88:0/3029287442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd404071bb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 --2- 172.21.15.88:0/3029287442 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd4040c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- 172.21.15.88:0/3029287442 >> 172.21.15.88:0/3029287442 conn(0x7fd4040ca720 msgr2=0x7fd4040cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- 172.21.15.88:0/3029287442 shutdown_connections 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.228+0000 7fd409074700 1 -- 172.21.15.88:0/3029287442 wait complete. 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 Processor -- start 2024-09-13T18:08:27.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 -- start start 2024-09-13T18:08:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd40406df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd40414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40406dae0 con 0x7fd404071720 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4041589b0 con 0x7fd40414fdb0 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd409074700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd404144d30 con 0x7fd404159100 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd408873700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 msgr2=0x7fd40414f290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd408873700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd40414f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:39544/0 (socket says 172.21.15.88:39544) 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 -- 172.21.15.88:0/788045039 learned_addr learned my addr 172.21.15.88:0/788045039 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:27.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd403fff700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd40406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 -- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 msgr2=0x7fd40414f290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd40414f290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 -- 172.21.15.88:0/788045039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 msgr2=0x7fd40406df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd40406df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 -- 172.21.15.88:0/788045039 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc00bd40 con 0x7fd40414fdb0 2024-09-13T18:08:27.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.232+0000 7fd4037fe700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400b7b0 tx=0x7fd3f400bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.236+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4003e60 con 0x7fd40414fdb0 2024-09-13T18:08:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.236+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f4005070 con 0x7fd40414fdb0 2024-09-13T18:08:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.236+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd404145000 con 0x7fd40414fdb0 2024-09-13T18:08:27.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.236+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4005440 con 0x7fd40414fdb0 2024-09-13T18:08:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.236+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd404156e90 con 0x7fd40414fdb0 2024-09-13T18:08:27.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd404156cf0 con 0x7fd40414fdb0 2024-09-13T18:08:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3f40055a0 con 0x7fd40414fdb0 2024-09-13T18:08:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd400ff9700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 0x7fd3e4068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:27.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd3f4083bc0 con 0x7fd40414fdb0 2024-09-13T18:08:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd403fff700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 0x7fd3e4068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:27.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.240+0000 7fd403fff700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 0x7fd3e4068c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000f60 tx=0x7fd3ec007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:27.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.248+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd404156cf0 con 0x7fd40414fdb0 2024-09-13T18:08:27.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.568+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fd40406dc90 con 0x7fd40414fdb0 2024-09-13T18:08:27.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.568+0000 7fd400ff9700 1 -- 172.21.15.88:0/788045039 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7fd40406dc90 con 0x7fd40414fdb0 2024-09-13T18:08:27.575 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":28,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":19,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:27.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 msgr2=0x7fd3e4068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:27.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 0x7fd3e4068c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec000f60 tx=0x7fd3ec007ef0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 msgr2=0x7fd40414ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:27.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400b7b0 tx=0x7fd3f400bac0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 shutdown_connections 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3e4066780 0x7fd3e4068c40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd404159100 0x7fd40414f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd40414fdb0 0x7fd40414ed50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 --2- 172.21.15.88:0/788045039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd404071720 0x7fd40406df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 >> 172.21.15.88:0/788045039 conn(0x7fd4040ca720 msgr2=0x7fd4041460b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 shutdown_connections 2024-09-13T18:08:27.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:27.572+0000 7fd409074700 1 -- 172.21.15.88:0/788045039 wait complete. 2024-09-13T18:08:30.597 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.724+0000 7fb99c883700 1 Processor -- start 2024-09-13T18:08:30.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.724+0000 7fb99c883700 1 -- start start 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb99c883700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb99c883700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb998153780 con 0x7fb9980c3f20 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb99c883700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9980c9d20 con 0x7fb9980c39d0 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb99c883700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980b20d0 con 0x7fb9981533a0 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb996ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9980c3f20 0x7fb9980cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36476/0 (socket says 172.21.15.88:36476) 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 learned_addr learned my addr 172.21.15.88:0/1271537809 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:30.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:08:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:30.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.728+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:30.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.932+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.932+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:08:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.932+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.932+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:30.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:30.932+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 initial writers = 527733.81 kB/sec 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 initial writers = 527717.58 kB/sec 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 527733.81 kB/sec 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 527733.81 kB/sec 2024-09-13T18:08:30.963 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 527733.81 kB/sec 2024-09-13T18:08:30.964 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:08:31.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:31.336+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:31.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:31.336+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:08:31.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:31.336+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:31.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:31.336+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:31.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:31.336+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:08:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:32.140+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:32.140+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:08:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:32.140+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:32.140+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:32.144 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:32.140+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T18:08:33.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 msgr2=0x7fb99815cf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:08:33.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.94:3300/0 conn(0x7fb9981533a0 0x7fb99815cf50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:33.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 -- 172.21.15.88:0/1271537809 >> v1:172.21.15.94:6789/0 conn(0x7fb9980c39d0 legacy=0x7fb998159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:33.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 -- 172.21.15.88:0/1271537809 >> v1:172.21.15.88:6789/0 conn(0x7fb9980c3f20 legacy=0x7fb9980cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 0x7fb984005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 -- 172.21.15.88:0/1271537809 --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9980b20d0 con 0x7fb984006300 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9957fa700 1 -- 172.21.15.88:0/1271537809 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb984008e30 con 0x7fb9840037b0 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 msgr2=0x7fb984005be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:33.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 0x7fb984005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 msgr2=0x7fb984008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:08:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 msgr2=0x7fb984008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:33.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.728+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:33.912 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:08:33.914 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 msgr2=0x7fb984005be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 0x7fb984005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 msgr2=0x7fb984008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 msgr2=0x7fb984008780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:33.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:33.932+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb9977fe700 1 -- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 msgr2=0x7fb984005be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> v2:172.21.15.88:3300/0 conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb9977fe700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 0x7fb984005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 msgr2=0x7fb984005be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9840037b0 0x7fb984005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb996ffd700 1 -- 172.21.15.88:0/1271537809 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980c9760 con 0x7fb984006300 2024-09-13T18:08:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb996ffd700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb984006300 0x7fb984008780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb988007dd0 tx=0x7fb988007330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2918fccbad2c45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb9967fc700 1 -- 172.21.15.88:0/1271537809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988005e50 con 0x7fb984006300 2024-09-13T18:08:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb9967fc700 1 -- 172.21.15.88:0/1271537809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988014400 con 0x7fb984006300 2024-09-13T18:08:34.341 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb9967fc700 1 -- 172.21.15.88:0/1271537809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988014770 con 0x7fb984006300 2024-09-13T18:08:34.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 -- 172.21.15.88:0/1271537809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb984006300 msgr2=0x7fb984008780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb984006300 0x7fb984008780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb988007dd0 tx=0x7fb988007330 comp rx=0 tx=0).stop 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb997fff700 1 -- 172.21.15.88:0/1271537809 reap_dead start 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 -- 172.21.15.88:0/1271537809 shutdown_connections 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 --2- 172.21.15.88:0/1271537809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb984006300 0x7fb984008780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 -- 172.21.15.88:0/1271537809 >> 172.21.15.88:0/1271537809 conn(0x7fb998071800 msgr2=0x7fb998071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 -- 172.21.15.88:0/1271537809 shutdown_connections 2024-09-13T18:08:34.343 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.336+0000 7fb99c883700 1 -- 172.21.15.88:0/1271537809 wait complete. 2024-09-13T18:08:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.340+0000 7fb99c883700 1 Processor -- start 2024-09-13T18:08:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.340+0000 7fb99c883700 1 -- start start 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb998151e80 0x7fb9981f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 0x7fb998149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb998158930 con 0x7fb99814ee90 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9980c6fb0 con 0x7fb998151e80 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb998158650 con 0x7fb998158c00 2024-09-13T18:08:34.349 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb997fff700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 msgr2=0x7fb998149680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb997fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 0x7fb998149680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48492/0 (socket says 172.21.15.88:48492) 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 -- 172.21.15.88:0/2832487312 learned_addr learned my addr 172.21.15.88:0/2832487312 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb9977fe700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb998151e80 0x7fb9981f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 -- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 msgr2=0x7fb998149680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 0x7fb998149680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 -- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb998151e80 msgr2=0x7fb9981f21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb998151e80 0x7fb9981f21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 -- 172.21.15.88:0/2832487312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98800f040 con 0x7fb99814ee90 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb996ffd700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb988015000 tx=0x7fb988001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.350 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988004a90 con 0x7fb99814ee90 2024-09-13T18:08:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb988004bf0 con 0x7fb99814ee90 2024-09-13T18:08:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb988000ed0 con 0x7fb99814ee90 2024-09-13T18:08:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99814e3b0 con 0x7fb99814ee90 2024-09-13T18:08:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.344+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99814e970 con 0x7fb99814ee90 2024-09-13T18:08:34.351 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb99814eb00 con 0x7fb99814ee90 2024-09-13T18:08:34.352 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb988004fa0 con 0x7fb99814ee90 2024-09-13T18:08:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb97ffff700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 0x7fb984069a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb988085460 con 0x7fb99814ee90 2024-09-13T18:08:34.353 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb9977fe700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 0x7fb984069a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.354 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.348+0000 7fb9977fe700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 0x7fb984069a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb98c006df0 tx=0x7fb98c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.356+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb988052740 con 0x7fb99814ee90 2024-09-13T18:08:34.598 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.592+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7fb99815cf50 con 0x7fb99814ee90 2024-09-13T18:08:34.599 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb97ffff700 1 -- 172.21.15.88:0/2832487312 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1533 (secure 0 0 0) 0x7fb98802d610 con 0x7fb99814ee90 2024-09-13T18:08:34.599 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":32,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:08:34.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 msgr2=0x7fb984069a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 0x7fb984069a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb98c006df0 tx=0x7fb98c008040 comp rx=0 tx=0).stop 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 msgr2=0x7fb998149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb988015000 tx=0x7fb988001120 comp rx=0 tx=0).stop 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 shutdown_connections 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb9840675a0 0x7fb984069a60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.603 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb998158c00 0x7fb998149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb99814ee90 0x7fb998149140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 --2- 172.21.15.88:0/2832487312 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb998151e80 0x7fb9981f21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 >> 172.21.15.88:0/2832487312 conn(0x7fb998071800 msgr2=0x7fb998159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 shutdown_connections 2024-09-13T18:08:34.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.596+0000 7fb99c883700 1 -- 172.21.15.88:0/2832487312 wait complete. 2024-09-13T18:08:34.615 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2024-09-13T18:08:34.615 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2024-09-13T18:08:34.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:08:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.728+0000 7f997a476700 1 Processor -- start 2024-09-13T18:08:34.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.728+0000 7f997a476700 1 -- start start 2024-09-13T18:08:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9974150070 0x7f99740c5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406cda0 con 0x7f99740721e0 2024-09-13T18:08:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9974155e10 con 0x7f997406cfb0 2024-09-13T18:08:34.736 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99740c6720 con 0x7f9974150070 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f99737fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f99740721e0 0x7f997406c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36492/0 (socket says 172.21.15.88:36492) 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f99737fe700 1 -- 172.21.15.88:0/1744048962 learned_addr learned my addr 172.21.15.88:0/1744048962 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9973fff700 1 --2- 172.21.15.88:0/1744048962 >> v2:172.21.15.88:3300/0 conn(0x7f9974150070 0x7f99740c5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9972ffd700 1 -- 172.21.15.88:0/1744048962 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005553145 0 0) 0x7f997406cda0 con 0x7f99740721e0 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9972ffd700 1 -- 172.21.15.88:0/1744048962 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99540035d0 con 0x7f99740721e0 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9973fff700 1 -- 172.21.15.88:0/1744048962 >> v1:172.21.15.94:6789/0 conn(0x7f997406cfb0 legacy=0x7f997406b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9973fff700 1 -- 172.21.15.88:0/1744048962 >> v1:172.21.15.88:6789/0 conn(0x7f99740721e0 legacy=0x7f997406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9973fff700 1 -- 172.21.15.88:0/1744048962 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99740c6a00 con 0x7f9974150070 2024-09-13T18:08:34.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9973fff700 1 --2- 172.21.15.88:0/1744048962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f99740c5190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f995c009850 tx=0x7f995c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82c5d3cd08ca946 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9972ffd700 1 -- 172.21.15.88:0/1744048962 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00f8a0 con 0x7f9974150070 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9972ffd700 1 -- 172.21.15.88:0/1744048962 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c00fa00 con 0x7f9974150070 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f9972ffd700 1 -- 172.21.15.88:0/1744048962 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00fdb0 con 0x7f9974150070 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- 172.21.15.88:0/1744048962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 msgr2=0x7f99740c5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 --2- 172.21.15.88:0/1744048962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f99740c5190 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f995c009850 tx=0x7f995c009b60 comp rx=0 tx=0).stop 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- 172.21.15.88:0/1744048962 shutdown_connections 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 --2- 172.21.15.88:0/1744048962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f99740c5190 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- 172.21.15.88:0/1744048962 >> 172.21.15.88:0/1744048962 conn(0x7f99740ca790 msgr2=0x7f99740caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- 172.21.15.88:0/1744048962 shutdown_connections 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- 172.21.15.88:0/1744048962 wait complete. 2024-09-13T18:08:34.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 Processor -- start 2024-09-13T18:08:34.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.732+0000 7f997a476700 1 -- start start 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f997406cfb0 0x7f9974147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99740721e0 0x7f99741450e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741eb5e0 con 0x7f9974150070 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740c8ea0 con 0x7f99740721e0 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99741eac40 con 0x7f997406cfb0 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9973fff700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f997406cfb0 msgr2=0x7f9974147980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:34.743 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9973fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f997406cfb0 0x7f9974147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48498/0 (socket says 172.21.15.88:48498) 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 -- 172.21.15.88:0/2791449656 learned_addr learned my addr 172.21.15.88:0/2791449656 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f99737fe700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99740721e0 0x7f99741450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f997406cfb0 msgr2=0x7f9974147980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f997406cfb0 0x7f9974147980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99740721e0 msgr2=0x7f99741450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99740721e0 0x7f99741450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f995c0094b0 con 0x7f9974150070 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f99737fe700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99740721e0 0x7f99741450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9978a13700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c430 tx=0x7f996c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0052d0 con 0x7f9974150070 2024-09-13T18:08:34.744 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c005430 con 0x7f9974150070 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0055a0 con 0x7f9974150070 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99741eaf20 con 0x7f9974150070 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.736+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99740c3520 con 0x7f9974150070 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f997a476700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 0x7f9974140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9974067ae0 con 0x7f99740ca350 2024-09-13T18:08:34.745 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9973fff700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 0x7f9974140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9973fff700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99741563b0 con 0x7f99740ca350 2024-09-13T18:08:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f996c0038e0 con 0x7f9974150070 2024-09-13T18:08:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9973fff700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 0x7f9974140d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f995c009850 tx=0x7f995c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9958066710 0x7f9958068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f996c0835d0 con 0x7f9974150070 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c01e070 con 0x7f99740ca350 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f99737fe700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9958066710 0x7f9958068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f995c010880 con 0x7f99740ca350 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 msgr2=0x7f9974140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 0x7f9974140d10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f995c009850 tx=0x7f995c004770 comp rx=0 tx=0).stop 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 msgr2=0x7f9974140d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f9970ff9700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99740ca350 0x7f9974140d10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.740+0000 7f99737fe700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9958066710 0x7f9958068bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f997414adc0 tx=0x7f9964009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.748+0000 7f997a476700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 0x7f9974141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.748+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99741eb720 con 0x7f9974146c40 2024-09-13T18:08:34.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.748+0000 7f9973fff700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 0x7f9974141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9973fff700 1 -- 172.21.15.88:0/2791449656 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f99740c5190 con 0x7f9974146c40 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9973fff700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 0x7f9974141250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c024d10 con 0x7f9974146c40 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4772 (secure 0 0 0) 0x7f995c02c6d0 con 0x7f9974146c40 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 msgr2=0x7f9974141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 0x7f9974141250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f995c000c00 tx=0x7f995c009240 comp rx=0 tx=0).stop 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 msgr2=0x7f9974141250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:34.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9970ff9700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974146c40 0x7f9974141250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-09-13T18:08:34.757 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.759 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.760 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:34.761 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.762 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:34.763 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.764 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.765 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.766 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:34.767 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.768 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.769 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.770 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.771 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.772 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.773 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:34.773 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:34.774 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9958066710 msgr2=0x7f9958068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9958066710 0x7f9958068bd0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f997414adc0 tx=0x7f9964009040 comp rx=0 tx=0).stop 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 msgr2=0x7f9974145620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c430 tx=0x7f996c00c7f0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f9978a13700 1 -- 172.21.15.88:0/2791449656 reap_dead start 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 shutdown_connections 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 --2- 172.21.15.88:0/2791449656 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9974150070 0x7f9974145620 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 >> 172.21.15.88:0/2791449656 conn(0x7f99740ca790 msgr2=0x7f99740717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 shutdown_connections 2024-09-13T18:08:34.775 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.752+0000 7f997a476700 1 -- 172.21.15.88:0/2791449656 wait complete. 2024-09-13T18:08:34.776 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:08:34.776 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2024-09-13T18:08:34.776 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:08:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 Processor -- start 2024-09-13T18:08:34.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 -- start start 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f91f406f280 0x7f91f40cac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91f40c93f0 0x7f91f40c9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f4070400 con 0x7f91f406eea0 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40b2260 con 0x7f91f40c93f0 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa9c5700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f40c9d80 con 0x7f91f406f280 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f91f40c93f0 0x7f91f40c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f99c3700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f91f406eea0 0x7f91f406fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36502/0 (socket says 172.21.15.88:36502) 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f99c3700 1 -- 172.21.15.88:0/1396549279 learned_addr learned my addr 172.21.15.88:0/1396549279 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f91c2700 1 --2- 172.21.15.88:0/1396549279 >> v2:172.21.15.94:3300/0 conn(0x7f91f406f280 0x7f91f40cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f89c1700 1 -- 172.21.15.88:0/1396549279 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059887658 0 0) 0x7f91f4070400 con 0x7f91f406eea0 2024-09-13T18:08:34.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f89c1700 1 -- 172.21.15.88:0/1396549279 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e00035d0 con 0x7f91f406eea0 2024-09-13T18:08:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 -- 172.21.15.88:0/1396549279 >> v2:172.21.15.94:3300/0 conn(0x7f91f406f280 msgr2=0x7f91f40cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 --2- 172.21.15.88:0/1396549279 >> v2:172.21.15.94:3300/0 conn(0x7f91f406f280 0x7f91f40cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 -- 172.21.15.88:0/1396549279 >> v1:172.21.15.88:6789/0 conn(0x7f91f406eea0 legacy=0x7f91f406fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 -- 172.21.15.88:0/1396549279 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f41590e0 con 0x7f91f40c93f0 2024-09-13T18:08:34.895 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91fa1c4700 1 --2- 172.21.15.88:0/1396549279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f40c93f0 0x7f91f40c9840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91f40b4e70 tx=0x7f91dc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d08858d28ce0cabd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f89c1700 1 -- 172.21.15.88:0/1396549279 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc011830 con 0x7f91f40c93f0 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f89c1700 1 -- 172.21.15.88:0/1396549279 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91dc011990 con 0x7f91f40c93f0 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.888+0000 7f91f89c1700 1 -- 172.21.15.88:0/1396549279 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91dc011d20 con 0x7f91f40c93f0 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- 172.21.15.88:0/1396549279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f40c93f0 msgr2=0x7f91f40c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/1396549279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f40c93f0 0x7f91f40c9840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f91f40b4e70 tx=0x7f91dc009b30 comp rx=0 tx=0).stop 2024-09-13T18:08:34.896 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- 172.21.15.88:0/1396549279 shutdown_connections 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/1396549279 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f40c93f0 0x7f91f40c9840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/1396549279 >> v2:172.21.15.94:3300/0 conn(0x7f91f406f280 0x7f91f40cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- 172.21.15.88:0/1396549279 >> 172.21.15.88:0/1396549279 conn(0x7f91f40cefa0 msgr2=0x7f91f4066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- 172.21.15.88:0/1396549279 shutdown_connections 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- 172.21.15.88:0/1396549279 wait complete. 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 Processor -- start 2024-09-13T18:08:34.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- start start 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f91f406eea0 0x7f91f41f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f40c93f0 0x7f91f41f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f4151310 con 0x7f91f406f280 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f414c3e0 con 0x7f91f40c93f0 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa9c5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41f2a30 con 0x7f91f406eea0 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91f91c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91f99c3700 1 -- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f91f406eea0 msgr2=0x7f91f41f1390 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.94:3301/0 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91f99c3700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f91f406eea0 0x7f91f41f1390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91f91c2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48532/0 (socket says 172.21.15.88:48532) 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91f91c2700 1 -- 172.21.15.88:0/256814249 learned_addr learned my addr 172.21.15.88:0/256814249 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:34.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.892+0000 7f91fa1c4700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f40c93f0 0x7f91f41f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f91f406eea0 msgr2=0x7f91f41f1390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f91f406eea0 0x7f91f41f1390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f40c93f0 msgr2=0x7f91f41f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f40c93f0 0x7f91f41f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc0094b0 con 0x7f91f406f280 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f91c2700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e9d0 tx=0x7f91e400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e4009720 con 0x7f91f406f280 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e400c850 con 0x7f91f406f280 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f414c100 con 0x7f91f406f280 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e400cbc0 con 0x7f91f406f280 2024-09-13T18:08:34.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f4151580 con 0x7f91f406f280 2024-09-13T18:08:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 0x7f91f41f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f406e910 con 0x7f91f41f18d0 2024-09-13T18:08:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f99c3700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 0x7f91f41f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f91e400cd20 con 0x7f91f406f280 2024-09-13T18:08:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f99c3700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f91f4159980 con 0x7f91f41f18d0 2024-09-13T18:08:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f99c3700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 0x7f91f41f1d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004ca0 tx=0x7f91ec00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f91d40666e0 0x7f91d4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f91e4084200 con 0x7f91f406f280 2024-09-13T18:08:34.903 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec007480 con 0x7f91f41f18d0 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.896+0000 7f91fa1c4700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f91d40666e0 0x7f91d4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f91ec0075e0 con 0x7f91f41f18d0 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 msgr2=0x7f91f41f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91f27fc700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 0x7f91f41f1d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004ca0 tx=0x7f91ec00cbc0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 msgr2=0x7f91f41f1d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91f27fc700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f41f18d0 0x7f91f41f1d50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.904 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.900+0000 7f91fa1c4700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f91d40666e0 0x7f91d4068ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009fd0 tx=0x7f91dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.908+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 0x7f91f41f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:34.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.908+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f41596a0 con 0x7f91f414cf40 2024-09-13T18:08:34.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.908+0000 7f91f99c3700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 0x7f91f41f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:34.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f99c3700 1 -- 172.21.15.88:0/256814249 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f91f4159c60 con 0x7f91f414cf40 2024-09-13T18:08:34.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f99c3700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 0x7f91f41f2290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004c40 tx=0x7f91ec0014d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:34.915 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ec021070 con 0x7f91f414cf40 2024-09-13T18:08:34.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4936 (secure 0 0 0) 0x7f91ec0126d0 con 0x7f91f414cf40 2024-09-13T18:08:34.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 msgr2=0x7f91f41f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 0x7f91f41f2290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004c40 tx=0x7f91ec0014d0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 msgr2=0x7f91f41f2290 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:08:34.916 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91f27fc700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f91f414cf40 0x7f91f41f2290 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004c40 tx=0x7f91ec0014d0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 32, 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: 1 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 0, 2024-09-13T18:08:34.917 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.918 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.919 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:08:34.920 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:08:34.921 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:08:34.922 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.923 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.924 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.925 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:08:34.926 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:08:34.928 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:08:34.929 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:08:34.930 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:08:34.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f91d40666e0 msgr2=0x7f91d4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f91d40666e0 0x7f91d4068ba0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009fd0 tx=0x7f91dc008030 comp rx=0 tx=0).stop 2024-09-13T18:08:34.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 msgr2=0x7f91f41f02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:34.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91e400e9d0 tx=0x7f91e400ece0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa1c4700 1 -- 172.21.15.88:0/256814249 reap_dead start 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 shutdown_connections 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 --2- 172.21.15.88:0/256814249 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f91f406f280 0x7f91f41f02a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 >> 172.21.15.88:0/256814249 conn(0x7f91f40cefa0 msgr2=0x7f91f4151c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 shutdown_connections 2024-09-13T18:08:34.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:34.912+0000 7f91fa9c5700 1 -- 172.21.15.88:0/256814249 wait complete. 2024-09-13T18:08:34.932 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2024-09-13T18:08:34.932 INFO:tasks.mon_thrash.mon_thrasher:waiting for 20.0 secs before reviving monitors 2024-09-13T18:08:53.212 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:08:53.212 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 rewriters = 652746.00 kB/sec 2024-09-13T18:08:53.213 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 rewriters = 652722.02 kB/sec 2024-09-13T18:08:53.213 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 652746.00 kB/sec 2024-09-13T18:08:53.213 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 652746.00 kB/sec 2024-09-13T18:08:53.213 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 652746.00 kB/sec 2024-09-13T18:08:53.213 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:08:54.933 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-13T18:08:54.933 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-13T18:08:54.933 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:08:54.933 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:08:54.936 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:08:54.936 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:08:54.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:08:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 Processor -- start 2024-09-13T18:08:55.058 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 -- start start 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66841533a0 0x7f668415cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f66840c39d0 0x7f6684159320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6684153780 con 0x7f66840c3f20 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840b20d0 con 0x7f66841533a0 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f668ad59700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66840c9d20 con 0x7f66840c39d0 2024-09-13T18:08:55.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f6689d57700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f66841533a0 0x7f668415cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f6689556700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66840c3f20 0x7f66840cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41516/0 (socket says 172.21.15.88:41516) 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.051+0000 7f6689556700 1 -- 172.21.15.88:0/3057288021 learned_addr learned my addr 172.21.15.88:0/3057288021 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668a558700 1 --2- 172.21.15.88:0/3057288021 >> v2:172.21.15.94:3300/0 conn(0x7f66840c39d0 0x7f6684159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6689d57700 1 -- 172.21.15.88:0/3057288021 >> v2:172.21.15.94:3300/0 conn(0x7f66840c39d0 msgr2=0x7f6684159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6689d57700 1 --2- 172.21.15.88:0/3057288021 >> v2:172.21.15.94:3300/0 conn(0x7f66840c39d0 0x7f6684159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6689d57700 1 -- 172.21.15.88:0/3057288021 >> v1:172.21.15.88:6789/0 conn(0x7f66840c3f20 legacy=0x7f66840cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6689d57700 1 -- 172.21.15.88:0/3057288021 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840c9760 con 0x7f66841533a0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6689d57700 1 --2- 172.21.15.88:0/3057288021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66841533a0 0x7f668415cf50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66840c8f50 tx=0x7f667c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dafcc768a773ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6688d55700 1 -- 172.21.15.88:0/3057288021 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c00e070 con 0x7f66841533a0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6688d55700 1 -- 172.21.15.88:0/3057288021 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c00bb20 con 0x7f66841533a0 2024-09-13T18:08:55.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f6688d55700 1 -- 172.21.15.88:0/3057288021 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c012430 con 0x7f66841533a0 2024-09-13T18:08:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 -- 172.21.15.88:0/3057288021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66841533a0 msgr2=0x7f668415cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 --2- 172.21.15.88:0/3057288021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66841533a0 0x7f668415cf50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f66840c8f50 tx=0x7f667c00b330 comp rx=0 tx=0).stop 2024-09-13T18:08:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 -- 172.21.15.88:0/3057288021 shutdown_connections 2024-09-13T18:08:55.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 --2- 172.21.15.88:0/3057288021 >> v2:172.21.15.94:3300/0 conn(0x7f66840c39d0 0x7f6684159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 --2- 172.21.15.88:0/3057288021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66841533a0 0x7f668415cf50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 -- 172.21.15.88:0/3057288021 >> 172.21.15.88:0/3057288021 conn(0x7f6684071800 msgr2=0x7f6684071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 -- 172.21.15.88:0/3057288021 shutdown_connections 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.055+0000 7f668ad59700 1 -- 172.21.15.88:0/3057288021 wait complete. 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 Processor -- start 2024-09-13T18:08:55.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- start start 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66840c3f20 0x7f66841559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841555b0 con 0x7f66840c39d0 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6684154ca0 con 0x7f66840c3f20 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6684154f60 con 0x7f66841533a0 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50612/0 (socket says 172.21.15.88:50612) 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689556700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66840c3f20 0x7f66841559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 -- 172.21.15.88:0/3901206164 learned_addr learned my addr 172.21.15.88:0/3901206164 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668a558700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668a558700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 msgr2=0x7f6684155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668a558700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 msgr2=0x7f6684155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668a558700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668a558700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 msgr2=0x7f6684155f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66840c3f20 msgr2=0x7f66841559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66840c3f20 0x7f66841559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 -- 172.21.15.88:0/3901206164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c009a70 con 0x7f66840c39d0 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f6689d57700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f667c014040 tx=0x7f667c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c012430 con 0x7f66840c39d0 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c020070 con 0x7f66840c39d0 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6684150bc0 con 0x7f66840c39d0 2024-09-13T18:08:55.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c004280 con 0x7f66840c39d0 2024-09-13T18:08:55.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.059+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66841f2830 con 0x7f66840c39d0 2024-09-13T18:08:55.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668415cf50 con 0x7f66840c39d0 2024-09-13T18:08:55.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f667c0043e0 con 0x7f66840c39d0 2024-09-13T18:08:55.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f667a7fc700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 0x7f6668068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:08:55.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f667c022070 con 0x7f66840c39d0 2024-09-13T18:08:55.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f6689556700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 0x7f6668068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:08:55.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.063+0000 7f6689556700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 0x7f6668068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66840b2cf0 tx=0x7f6674009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:08:55.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.071+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f667c0539e0 con 0x7f66840c39d0 2024-09-13T18:08:55.315 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:08:55.311+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f668414fc40 con 0x7f66840c39d0 2024-09-13T18:09:00.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.295+0000 7f667a7fc700 1 -- 172.21.15.88:0/3901206164 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1533 (secure 0 0 0) 0x7f667c057000 con 0x7f66840c39d0 2024-09-13T18:09:00.302 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":36,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 msgr2=0x7f6668068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 0x7f6668068c20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f66840b2cf0 tx=0x7f6674009040 comp rx=0 tx=0).stop 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 msgr2=0x7f66840cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f667c014040 tx=0x7f667c004af0 comp rx=0 tx=0).stop 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 shutdown_connections 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6668066760 0x7f6668068c20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:00.307 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f66841533a0 0x7f6684155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f66840c3f20 0x7f66841559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 --2- 172.21.15.88:0/3901206164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66840c39d0 0x7f66840cdb40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 >> 172.21.15.88:0/3901206164 conn(0x7f6684071800 msgr2=0x7f6684159170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.299+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 shutdown_connections 2024-09-13T18:09:00.308 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:00.303+0000 7f668ad59700 1 -- 172.21.15.88:0/3901206164 wait complete. 2024-09-13T18:09:01.667 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:09:01.667 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 readers = 7567138.50 kB/sec 2024-09-13T18:09:01.667 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 readers = 7564097.06 kB/sec 2024-09-13T18:09:01.667 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 7567138.50 kB/sec 2024-09-13T18:09:01.667 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 7567138.50 kB/sec 2024-09-13T18:09:01.668 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 7567138.50 kB/sec 2024-09-13T18:09:01.668 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:09:03.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:09:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.443+0000 7f99f36b6700 1 Processor -- start 2024-09-13T18:09:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.443+0000 7f99f36b6700 1 -- start start 2024-09-13T18:09:03.452 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99ec14fa60 0x7f99ec071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec1564d0 con 0x7f99ec070c30 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec0c72d0 con 0x7f99ec14fa60 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec155620 con 0x7f99ec14f680 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99ec14fa60 0x7f99ec071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f99ec14fa60 0x7f99ec071ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51904/0 (socket says 172.21.15.88:51904) 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 -- 172.21.15.88:0/729144878 learned_addr learned my addr 172.21.15.88:0/729144878 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f1452700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f1452700 1 -- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 msgr2=0x7f99ec0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f1452700 1 -- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 msgr2=0x7f99ec0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f1452700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f1452700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99e3fff700 1 -- 172.21.15.88:0/729144878 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083363449 0 0) 0x7f99e4001490 con 0x7f99ec070c30 2024-09-13T18:09:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 -- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 msgr2=0x7f99ec0c6d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:09:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 -- 172.21.15.88:0/729144878 >> v1:172.21.15.94:6789/0 conn(0x7f99ec070c30 legacy=0x7f99ec158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 -- 172.21.15.88:0/729144878 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec1558c0 con 0x7f99ec14fa60 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f0c51700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec071ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c594dfe04bb3cce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99e3fff700 1 -- 172.21.15.88:0/729144878 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00dc40 con 0x7f99ec14fa60 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99e3fff700 1 -- 172.21.15.88:0/729144878 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00dda0 con 0x7f99ec14fa60 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99e3fff700 1 -- 172.21.15.88:0/729144878 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc004250 con 0x7f99ec14fa60 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- 172.21.15.88:0/729144878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 msgr2=0x7f99ec071ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec071ac0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99dc006fd0 tx=0x7f99dc00bea0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- 172.21.15.88:0/729144878 shutdown_connections 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec071ac0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 --2- 172.21.15.88:0/729144878 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec14f680 0x7f99ec0c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- 172.21.15.88:0/729144878 >> 172.21.15.88:0/729144878 conn(0x7f99ec0cb290 msgr2=0x7f99ec0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- 172.21.15.88:0/729144878 shutdown_connections 2024-09-13T18:09:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.447+0000 7f99f36b6700 1 -- 172.21.15.88:0/729144878 wait complete. 2024-09-13T18:09:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 Processor -- start 2024-09-13T18:09:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 -- start start 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99ec14f680 0x7f99ec14c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec14ca90 con 0x7f99ec14fa60 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec157c70 con 0x7f99ec14f680 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f36b6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec156710 con 0x7f99ec070c30 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51918/0 (socket says 172.21.15.88:51918) 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 -- 172.21.15.88:0/857531187 learned_addr learned my addr 172.21.15.88:0/857531187 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1452700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f0c51700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99ec14f680 0x7f99ec14c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1452700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 msgr2=0x7f99ec1ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1452700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 msgr2=0x7f99ec1ef630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1452700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1452700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 msgr2=0x7f99ec1ef630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.451+0000 7f99f1c53700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99ec14f680 msgr2=0x7f99ec14c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f1c53700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99ec14f680 0x7f99ec14c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f1c53700 1 -- 172.21.15.88:0/857531187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc00b820 con 0x7f99ec14fa60 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f1c53700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99e400cc10 tx=0x7f99e400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4003e50 con 0x7f99ec14fa60 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400a6a0 con 0x7f99ec14fa60 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec157ec0 con 0x7f99ec14fa60 2024-09-13T18:09:03.461 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e400aa50 con 0x7f99ec14fa60 2024-09-13T18:09:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec156c90 con 0x7f99ec14fa60 2024-09-13T18:09:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec0c2a90 con 0x7f99ec14fa60 2024-09-13T18:09:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f99e400abb0 con 0x7f99ec14fa60 2024-09-13T18:09:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 0x7f99d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f99e40839f0 con 0x7f99ec14fa60 2024-09-13T18:09:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.455+0000 7f99f1452700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 0x7f99d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.459+0000 7f99f1452700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 0x7f99d0068c20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009100 tx=0x7f99e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.467+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f99e4050ce0 con 0x7f99ec14fa60 2024-09-13T18:09:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f99ec1564d0 con 0x7f99ec14fa60 2024-09-13T18:09:03.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99e1ffb700 1 -- 172.21.15.88:0/857531187 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1539 (secure 0 0 0) 0x7f99ec1564d0 con 0x7f99ec14fa60 2024-09-13T18:09:03.704 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 msgr2=0x7f99d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 0x7f99d0068c20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f99e8009100 tx=0x7f99e8008040 comp rx=0 tx=0).stop 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 msgr2=0x7f99ec1571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f99e400cc10 tx=0x7f99e400cf20 comp rx=0 tx=0).stop 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 shutdown_connections 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f99d0066760 0x7f99d0068c20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.706 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f99ec14fa60 0x7f99ec1571b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99ec14f680 0x7f99ec14c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 --2- 172.21.15.88:0/857531187 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99ec070c30 0x7f99ec1ef630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 >> 172.21.15.88:0/857531187 conn(0x7f99ec0cb290 msgr2=0x7f99ec0cb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:03.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 shutdown_connections 2024-09-13T18:09:03.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.699+0000 7f99f36b6700 1 -- 172.21.15.88:0/857531187 wait complete. 2024-09-13T18:09:03.718 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:09:03.718 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2024-09-13T18:09:03.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-13T18:09:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 Processor -- start 2024-09-13T18:09:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 -- start start 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f77b4152790 0x7f77b406b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77b4159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b406bbc0 con 0x7f77b40c5ef0 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b4159790 con 0x7f77b4152790 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b359e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40c79e0 con 0x7f77b4072230 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f77b40c5ef0 0x7f77b40c6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:35992/0 (socket says 172.21.15.88:35992) 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b2d9d700 1 -- 172.21.15.88:0/2913208040 learned_addr learned my addr 172.21.15.88:0/2913208040 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:03.836 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b259c700 1 --2- 172.21.15.88:0/2913208040 >> v2:172.21.15.88:3300/0 conn(0x7f77b4152790 0x7f77b406b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77b4159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138970775 0 0) 0x7f77b406bbc0 con 0x7f77b40c5ef0 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77a00035d0 con 0x7f77b40c5ef0 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 msgr2=0x7f77b4159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 msgr2=0x7f77b4159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77b4159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77b4159250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 595895289 0 0) 0x7f77a00035d0 con 0x7f77b40c5ef0 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 msgr2=0x7f77b4159250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77b4159250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 >> v2:172.21.15.88:3300/0 conn(0x7f77b4152790 msgr2=0x7f77b406b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 --2- 172.21.15.88:0/2913208040 >> v2:172.21.15.88:3300/0 conn(0x7f77b4152790 0x7f77b406b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.837 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40c5880 con 0x7f77b40c5ef0 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f77ac0019f0 con 0x7f77b40c5ef0 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b259c700 1 --2- 172.21.15.88:0/2913208040 >> v2:172.21.15.88:3300/0 conn(0x7f77b4152790 0x7f77b406b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 >> v1:172.21.15.88:6789/0 conn(0x7f77b40c5ef0 legacy=0x7f77b40c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77a0004870 0x7f77a0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77a0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4159790 con 0x7f77a0004870 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40c79e0 con 0x7f77a0003a20 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a000ba60 con 0x7f77b4072230 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77a0004870 0x7f77a0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77a0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b259c700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 msgr2=0x7f77a0005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77a0005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0003a20 msgr2=0x7f77a0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2913208040 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a00035d0 con 0x7f77a0004870 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b4072230 0x7f77a0005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b259c700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0003a20 0x7f77a0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77a0004870 0x7f77a0004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f779c009870 tx=0x7f77a00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932c9f066048ade3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.827+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c00c070 con 0x7f77a0004870 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c013630 con 0x7f77a0004870 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b1d9b700 1 -- 172.21.15.88:0/2913208040 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c0139e0 con 0x7f77a0004870 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2913208040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77a0004870 msgr2=0x7f77a0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 --2- 172.21.15.88:0/2913208040 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77a0004870 0x7f77a0004cf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f779c009870 tx=0x7f77a00058a0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b2d9d700 1 -- 172.21.15.88:0/2913208040 reap_dead start 2024-09-13T18:09:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2913208040 shutdown_connections 2024-09-13T18:09:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2913208040 >> 172.21.15.88:0/2913208040 conn(0x7f77b40664b0 msgr2=0x7f77b406eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2913208040 shutdown_connections 2024-09-13T18:09:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2913208040 wait complete. 2024-09-13T18:09:03.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 Processor -- start 2024-09-13T18:09:03.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- start start 2024-09-13T18:09:03.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0004870 0x7f77b41ef390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b40c94e0 0x7f77b4141480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b41eef00 con 0x7f77b40c3fc0 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4151920 con 0x7f77a0004870 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4151c00 con 0x7f77b40c94e0 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51946/0 (socket says 172.21.15.88:51946) 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2998153453 learned_addr learned my addr 172.21.15.88:0/2998153453 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0004870 0x7f77b41ef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b40c94e0 0x7f77b4141480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b40c94e0 msgr2=0x7f77b4141480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b40c94e0 0x7f77b4141480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0004870 msgr2=0x7f77b41ef390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0004870 0x7f77b41ef390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b41eeb90 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f77a0004870 0x7f77b41ef390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f77b40c94e0 0x7f77b4141480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77a9d9b700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77a00047a0 tx=0x7f779c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c013bb0 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c013d30 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b4142970 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f779c013ea0 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.831+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b4151ee0 con 0x7f77b40c3fc0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b359e700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 0x7f77b4144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4068400 con 0x7f77b41419c0 2024-09-13T18:09:03.845 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 0x7f77b4144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b259c700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77b4071750 con 0x7f77b41419c0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f779c003900 con 0x7f77b40c3fc0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 0x7f77b4144dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77a4011870 tx=0x7f77a4011c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7794066730 0x7f7794068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f779c085140 con 0x7f77b40c3fc0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7794066730 0x7f7794068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4004230 con 0x7f77b41419c0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f77a4011e70 con 0x7f77b41419c0 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 msgr2=0x7f77b4144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 0x7f77b4144dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f77a4011870 tx=0x7f77a4011c30 comp rx=0 tx=0).stop 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 msgr2=0x7f77b4144dc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.835+0000 7f77ab7fe700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b41419c0 0x7f77b4144dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.839+0000 7f77b2d9d700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7794066730 0x7f7794068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77b40c62d0 tx=0x7f77ac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.847+0000 7f77b359e700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 0x7f77b4145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.847+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4071470 con 0x7f77b4145300 2024-09-13T18:09:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.847+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 0x7f77b4145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.847+0000 7f77b259c700 1 -- 172.21.15.88:0/2998153453 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f77b4071a30 con 0x7f77b4145300 2024-09-13T18:09:03.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b259c700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 0x7f77b4145710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77a4011870 tx=0x7f77a40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4024070 con 0x7f77b4145300 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 <== mon.0 v2:172.21.15.88:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4783 (secure 0 0 0) 0x7f77a40045d0 con 0x7f77b4145300 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 msgr2=0x7f77b4145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 0x7f77b4145710 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f77a4011870 tx=0x7f77a40047e0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 msgr2=0x7f77b4145710 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77ab7fe700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b4145300 0x7f77b4145710 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.856 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "leader", 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:09:03.857 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:09:03.858 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:09:03.859 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:09:03.860 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:09:03.861 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:03.862 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:03.863 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:09:03.864 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.865 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.866 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.867 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 3 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:03.868 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:09:03.869 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7794066730 msgr2=0x7f7794068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.869 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7794066730 0x7f7794068bf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f77b40c62d0 tx=0x7f77ac009040 comp rx=0 tx=0).stop 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 msgr2=0x7f77b4157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b2d9d700 1 -- 172.21.15.88:0/2998153453 reap_dead start 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77a00047a0 tx=0x7f779c0047e0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 shutdown_connections 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 --2- 172.21.15.88:0/2998153453 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77b40c3fc0 0x7f77b4157450 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 >> 172.21.15.88:0/2998153453 conn(0x7f77b40664b0 msgr2=0x7f77b414e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 shutdown_connections 2024-09-13T18:09:03.870 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.851+0000 7f77b359e700 1 -- 172.21.15.88:0/2998153453 wait complete. 2024-09-13T18:09:03.873 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:09:03.873 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2024-09-13T18:09:03.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-13T18:09:03.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 Processor -- start 2024-09-13T18:09:03.989 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 -- start start 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9a3c0ca790 0x7f9a3c0c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0cc6d0 con 0x7f9a3c151150 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0cc2b0 con 0x7f9a3c0ca790 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a40fcb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c070cb0 con 0x7f9a3c151530 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a3a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a3c151150 0x7f9a3c0704c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36000/0 (socket says 172.21.15.88:36000) 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a3a59c700 1 -- 172.21.15.88:0/1878527210 learned_addr learned my addr 172.21.15.88:0/1878527210 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/1878527210 >> v2:172.21.15.94:3300/0 conn(0x7f9a3c0ca790 0x7f9a3c0c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.991 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714599442 0 0) 0x7f9a3c0cc6d0 con 0x7f9a3c151150 2024-09-13T18:09:03.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.983+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a240035d0 con 0x7f9a3c151150 2024-09-13T18:09:03.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a39d9b700 1 -- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-13T18:09:03.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a39d9b700 1 -- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:09:03.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:03.992 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:03.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943367707 0 0) 0x7f9a240035d0 con 0x7f9a3c151150 2024-09-13T18:09:03.993 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c06dc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/1878527210 >> v1:172.21.15.88:6789/0 conn(0x7f9a3c151150 legacy=0x7f9a3c0704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/1878527210 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0cb910 con 0x7f9a3c0ca790 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c0c4fb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009d90 tx=0x7f9a3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f07ac7085772427 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400e070 con 0x7f9a3c0ca790 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a34003a40 con 0x7f9a3c0ca790 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a3959a700 1 -- 172.21.15.88:0/1878527210 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c001670 con 0x7f9a3c0ca790 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 -- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c0ca790 msgr2=0x7f9a3c0c4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c0c4fb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a34009d90 tx=0x7f9a3400b330 comp rx=0 tx=0).stop 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 -- 172.21.15.88:0/1878527210 shutdown_connections 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c0c4fb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/1878527210 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.994 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 -- 172.21.15.88:0/1878527210 >> 172.21.15.88:0/1878527210 conn(0x7f9a3c066090 msgr2=0x7f9a3c071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:03.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 -- 172.21.15.88:0/1878527210 shutdown_connections 2024-09-13T18:09:03.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.987+0000 7f9a40fcb700 1 -- 172.21.15.88:0/1878527210 wait complete. 2024-09-13T18:09:03.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 Processor -- start 2024-09-13T18:09:03.995 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- start start 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c151150 0x7f9a3c1dd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c13dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1e1800 con 0x7f9a3c0ca790 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1df630 con 0x7f9a3c151150 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1de630 con 0x7f9a3c151530 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:51976/0 (socket says 172.21.15.88:51976) 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 -- 172.21.15.88:0/3215579484 learned_addr learned my addr 172.21.15.88:0/3215579484 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c13dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c151150 0x7f9a3c1dd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:03.998 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c13dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c13dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c13dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c13dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 msgr2=0x7f9a3c13dff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a3c151530 0x7f9a3c13dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c151150 msgr2=0x7f9a3c1dd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c151150 0x7f9a3c1dd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a34009a70 con 0x7f9a3c0ca790 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a3a59c700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011e0 tx=0x7f9a2c00ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004ca0 con 0x7f9a3c0ca790 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c004e00 con 0x7f9a3c0ca790 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c1e1e00 con 0x7f9a3c0ca790 2024-09-13T18:09:03.999 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0072f0 con 0x7f9a3c0ca790 2024-09-13T18:09:04.000 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.991+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c1de8f0 con 0x7f9a3c0ca790 2024-09-13T18:09:04.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 0x7f9a3c1deab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c067ae0 con 0x7f9a3c1dfdf0 2024-09-13T18:09:04.001 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9a2c007450 con 0x7f9a3c0ca790 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 0x7f9a3c1deab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a39d9b700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a3c070f90 con 0x7f9a3c1dfdf0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a1c066760 0x7f9a1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9a2c084090 con 0x7f9a3c0ca790 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 0x7f9a3c1deab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c156ef0 tx=0x7f9a30011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a1c066760 0x7f9a1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30004550 con 0x7f9a3c1dfdf0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a3ad9d700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a1c066760 0x7f9a1c068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400b370 tx=0x7f9a34011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f9a300036c0 con 0x7f9a3c1dfdf0 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 msgr2=0x7f9a3c1deab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 0x7f9a3c1deab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c156ef0 tx=0x7f9a30011b90 comp rx=0 tx=0).stop 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 msgr2=0x7f9a3c1deab0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:04.002 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:03.995+0000 7f9a2affd700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c1dfdf0 0x7f9a3c1deab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 0x7f9a3c1f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1e01d0 con 0x7f9a3c13e530 2024-09-13T18:09:04.013 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 0x7f9a3c1f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a39d9b700 1 -- 172.21.15.88:0/3215579484 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f9a3c0cbed0 con 0x7f9a3c13e530 2024-09-13T18:09:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a39d9b700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 0x7f9a3c1f0070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a3001a000 tx=0x7f9a30004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.014 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a30025070 con 0x7f9a3c13e530 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 <== mon.1 v2:172.21.15.94:3300/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4947 (secure 0 0 0) 0x7f9a30015460 con 0x7f9a3c13e530 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 msgr2=0x7f9a3c1f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a2affd700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 0x7f9a3c1f0070 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a3001a000 tx=0x7f9a30004770 comp rx=0 tx=0).stop 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.007+0000 7f9a2affd700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 msgr2=0x7f9a3c1f0070 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a2affd700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a3c13e530 0x7f9a3c1f0070 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.015 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 3, 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:09:04.016 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.017 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:04.018 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:09:04.019 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:04.020 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:04.021 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:09:04.022 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.023 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.024 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:04.025 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:09:04.026 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": [ 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.027 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": [ 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:04.028 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 5 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": [ 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 2 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:04.029 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:09:04.030 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:04.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a1c066760 msgr2=0x7f9a1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f9a1c066760 0x7f9a1c068c20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400b370 tx=0x7f9a34011000 comp rx=0 tx=0).stop 2024-09-13T18:09:04.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 msgr2=0x7f9a3c1df0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a3ad9d700 1 -- 172.21.15.88:0/3215579484 reap_dead start 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0011e0 tx=0x7f9a2c00ca50 comp rx=0 tx=0).stop 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 shutdown_connections 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 --2- 172.21.15.88:0/3215579484 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a3c0ca790 0x7f9a3c1df0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 >> 172.21.15.88:0/3215579484 conn(0x7f9a3c066090 msgr2=0x7f9a3c14f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 shutdown_connections 2024-09-13T18:09:04.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.011+0000 7f9a40fcb700 1 -- 172.21.15.88:0/3215579484 wait complete. 2024-09-13T18:09:04.032 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:09:04.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2024-09-13T18:09:04.033 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-13T18:09:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 Processor -- start 2024-09-13T18:09:04.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 -- start start 2024-09-13T18:09:04.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f83280ca700 0x7f83280cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83280cc480 con 0x7f8328152f70 2024-09-13T18:09:04.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832815c800 con 0x7f83280caae0 2024-09-13T18:09:04.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832cd85700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832815cae0 con 0x7f83280ca700 2024-09-13T18:09:04.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f8326d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8328152f70 0x7f832806fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36010/0 (socket says 172.21.15.88:36010) 2024-09-13T18:09:04.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f8326d9d700 1 -- 172.21.15.88:0/345618483 learned_addr learned my addr 172.21.15.88:0/345618483 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:04.162 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832659c700 1 --2- 172.21.15.88:0/345618483 >> v2:172.21.15.94:3300/0 conn(0x7f83280ca700 0x7f83280cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47600365 0 0) 0x7f83280cc480 con 0x7f8328152f70 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83100035d0 con 0x7f8328152f70 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960026293 0 0) 0x7f832815c800 con 0x7f83280caae0 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83280cc480 con 0x7f83280caae0 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1635999334 0 0) 0x7f83100035d0 con 0x7f8328152f70 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 >> v2:172.21.15.94:3300/0 conn(0x7f83280ca700 msgr2=0x7f83280cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 --2- 172.21.15.88:0/345618483 >> v2:172.21.15.94:3300/0 conn(0x7f83280ca700 0x7f83280cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 >> v1:172.21.15.94:6789/0 conn(0x7f83280caae0 legacy=0x7f83280c5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832815cdc0 con 0x7f8328152f70 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f83200019f0 con 0x7f8328152f70 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 >> v1:172.21.15.88:6789/0 conn(0x7f8328152f70 legacy=0x7f832806fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8310003bb0 0x7f8310003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 0x7f8310004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310005230 0x7f831000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832815cae0 con 0x7f8310004870 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831000c020 con 0x7f8310005230 2024-09-13T18:09:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831000c1e0 con 0x7f8310003bb0 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f8325d9b700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 0x7f8310004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f832659c700 1 --2- 172.21.15.88:0/345618483 >> v2:172.21.15.94:3300/0 conn(0x7f83280ca700 0x7f83280cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.147+0000 7f8326d9d700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310005230 0x7f831000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 -- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8310003bb0 msgr2=0x7f8310003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8310003bb0 0x7f8310003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 -- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310005230 msgr2=0x7f831000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310005230 0x7f831000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8326d9d700 1 -- 172.21.15.88:0/345618483 reap_dead start 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 -- 172.21.15.88:0/345618483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100035d0 con 0x7f8310004870 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 0x7f8310004cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83280caef0 tx=0x7f83100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3803c74821f4ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c001440 con 0x7f8310004870 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c005310 con 0x7f8310004870 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832559a700 1 -- 172.21.15.88:0/345618483 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c001d50 con 0x7f8310004870 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 msgr2=0x7f8310004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 0x7f8310004cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83280caef0 tx=0x7f83100058a0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- 172.21.15.88:0/345618483 shutdown_connections 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 --2- 172.21.15.88:0/345618483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8310004870 0x7f8310004cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- 172.21.15.88:0/345618483 >> 172.21.15.88:0/345618483 conn(0x7f83280cf130 msgr2=0x7f83280cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- 172.21.15.88:0/345618483 shutdown_connections 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- 172.21.15.88:0/345618483 wait complete. 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 Processor -- start 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- start start 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310004870 0x7f83280cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 0x7f83281e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832814c470 con 0x7f83281f1ea0 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8328154d80 con 0x7f8310004870 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832cd85700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8328155040 con 0x7f83280ce550 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8326d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8326d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52000/0 (socket says 172.21.15.88:52000) 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8326d9d700 1 -- 172.21.15.88:0/4139819016 learned_addr learned my addr 172.21.15.88:0/4139819016 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310004870 0x7f83280cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.151+0000 7f8325d9b700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 0x7f83281e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8325d9b700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 msgr2=0x7f83281e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8325d9b700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 msgr2=0x7f83281e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8325d9b700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 0x7f83281e24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8325d9b700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 0x7f83281e24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 msgr2=0x7f83281e24c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:09:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83280ce550 0x7f83281e24c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310004870 msgr2=0x7f83280cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8310004870 0x7f83280cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8328153ae0 con 0x7f83281f1ea0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8326d9d700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8320001330 tx=0x7f8320001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000e940 con 0x7f83281f1ea0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832000eaa0 con 0x7f83281f1ea0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000ee50 con 0x7f83281f1ea0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8328153dc0 con 0x7f83281f1ea0 2024-09-13T18:09:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8328154380 con 0x7f83281f1ea0 2024-09-13T18:09:04.169 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f832001d460 con 0x7f83281f1ea0 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832cd85700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832806ea60 con 0x7f83281f2840 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8308066730 0x7f8308068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f83200844b0 con 0x7f83281f1ea0 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.155+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.159+0000 7f8325d9b700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8308066730 0x7f8308068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.159+0000 7f8325d9b700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8308066730 0x7f8308068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f831c014040 tx=0x7f831c011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:04.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.359+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.359+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-13T18:09:04.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.359+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:04.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.359+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:04.364 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.359+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:09:04.434 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:09:04.437 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:09:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.763+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.763+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 20 2024-09-13T18:09:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.763+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T18:09:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.763+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:09:04.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:04.763+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Children see throughput for 1 re-readers = 6443362.50 kB/sec 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Parent sees throughput for 1 re-readers = 6441359.12 kB/sec 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Min throughput per process = 6443362.50 kB/sec 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Max throughput per process = 6443362.50 kB/sec 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Avg throughput per process = 6443362.50 kB/sec 2024-09-13T18:09:05.482 INFO:tasks.workunit.client.0.smithi088.stdout: Min xfer = 10485760.00 kB 2024-09-13T18:09:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f832815d380 con 0x7f83281f2840 2024-09-13T18:09:05.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8318018d60 tx=0x7f8318018e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:05.573 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180169d0 con 0x7f83281f2840 2024-09-13T18:09:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+9332 (secure 0 0 0) 0x7f8318016b30 con 0x7f83281f2840 2024-09-13T18:09:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8318018d60 tx=0x7f8318018e40 comp rx=0 tx=0).stop 2024-09-13T18:09:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 msgr2=0x7f832814b3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:05.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.567+0000 7f8316ffd700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f83281f2840 0x7f832814b3d0 secure :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f8318018d60 tx=0x7f8318018e40 comp rx=0 tx=0).stop 2024-09-13T18:09:05.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832cd85700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 0x7f832814bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8328153c70 con 0x7f832814b910 2024-09-13T18:09:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 0x7f832814bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832659c700 1 -- 172.21.15.88:0/4139819016 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- command(tid 2: {"prefix": "mon_status"}) v1 -- 0x7f832814c230 con 0x7f832814b910 2024-09-13T18:09:05.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832659c700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 0x7f832814bcf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8318022000 tx=0x7f8318004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:05.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83180038d0 con 0x7f832814b910 2024-09-13T18:09:05.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 <== mon.2 v2:172.21.15.94:3301/0 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+4449 (secure 0 0 0) 0x7f831802c070 con 0x7f832814b910 2024-09-13T18:09:05.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 msgr2=0x7f832814bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 0x7f832814bcf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8318022000 tx=0x7f8318004770 comp rx=0 tx=0).stop 2024-09-13T18:09:05.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 msgr2=0x7f832814bcf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f8316ffd700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f832814b910 0x7f832814bcf0 secure :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8318022000 tx=0x7f8318004770 comp rx=0 tx=0).stop 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "peon", 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: "election_epoch": 38, 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum": [ 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: 0, 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: 1, 2024-09-13T18:09:05.591 INFO:teuthology.orchestra.run.smithi088.stdout: 2 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_age": 4, 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "required_con": "2449958758054445060", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "required_mon": [ 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:05.592 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_con": "4540138322906710015", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "quorum_mon": [ 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:05.593 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "outside_quorum": [], 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "extra_probe_peers": [], 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_provider": [], 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "monmap": { 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "fsid": "70755675-8bb0-445c-8ac9-8148c6ab712e", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "modified": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "created": "2024-09-13T18:04:34.255927Z", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release": 18, 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "min_mon_release_name": "reef", 2024-09-13T18:09:05.594 INFO:teuthology.orchestra.run.smithi088.stdout: "election_strategy": 1, 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "disallowed_leaders: ": "", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false, 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "tiebreaker_mon": "", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "removed_ranks: ": "", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "features": { 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "persistent": [ 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "kraken", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "luminous", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "mimic", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap-prune", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "nautilus", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "octopus", 2024-09-13T18:09:05.595 INFO:teuthology.orchestra.run.smithi088.stdout: "pacific", 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "elector-pinging", 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "quincy", 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "reef" 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "optional": [] 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "mons": [ 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 0, 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "a", 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:05.596 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:3300", 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789", 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.88:6789/0", 2024-09-13T18:09:05.597 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.88:6789/0", 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 1, 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "b", 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3300", 2024-09-13T18:09:05.598 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789", 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6789/0", 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6789/0", 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:05.599 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "rank": 2, 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "c", 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addrs": { 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "addrvec": [ 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v2", 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:3301", 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.600 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790", 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 0 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "172.21.15.94:6790/0", 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "public_addr": "172.21.15.94:6790/0", 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "priority": 0, 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "weight": 0, 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: "crush_location": "{}" 2024-09-13T18:09:05.601 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "feature_map": { 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": [ 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "client": [ 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "features": "0x3f01cfbffffdffff", 2024-09-13T18:09:05.602 INFO:teuthology.orchestra.run.smithi088.stdout: "release": "reef", 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 1 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout: "stretch_mode": false 2024-09-13T18:09:05.603 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:05.604 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.583+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8308066730 msgr2=0x7f8308068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f8308066730 0x7f8308068bf0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f831c014040 tx=0x7f831c011000 comp rx=0 tx=0).stop 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 msgr2=0x7f83281f2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f8326d9d700 1 -- 172.21.15.88:0/4139819016 reap_dead start 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8320001330 tx=0x7f8320001aa0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 shutdown_connections 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 --2- 172.21.15.88:0/4139819016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f83281f1ea0 0x7f83281f2300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 >> 172.21.15.88:0/4139819016 conn(0x7f83280cf130 msgr2=0x7f8328070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 shutdown_connections 2024-09-13T18:09:05.605 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.587+0000 7f832cd85700 1 -- 172.21.15.88:0/4139819016 wait complete. 2024-09-13T18:09:05.605 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2024-09-13T18:09:05.606 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-13T18:09:05.606 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-13T18:09:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 Processor -- start 2024-09-13T18:09:05.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 -- start start 2024-09-13T18:09:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4000c1f70 0x7fa4000c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4000c1db0 con 0x7fa4001613e0 2024-09-13T18:09:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa400160f50 con 0x7fa4001574b0 2024-09-13T18:09:05.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4000c5b40 con 0x7fa4000c1f70 2024-09-13T18:09:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fe7fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4001613e0 0x7fa400165ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36026/0 (socket says 172.21.15.88:36026) 2024-09-13T18:09:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fe7fc700 1 -- 172.21.15.88:0/4219702759 learned_addr learned my addr 172.21.15.88:0/4219702759 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:05.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3ff7fe700 1 --2- 172.21.15.88:0/4219702759 >> v2:172.21.15.88:3300/0 conn(0x7fa4000c1f70 0x7fa4000c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fdffb700 1 -- 172.21.15.88:0/4219702759 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618875935 0 0) 0x7fa3e8001490 con 0x7fa4001613e0 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3fdffb700 1 -- 172.21.15.88:0/4219702759 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3e00035d0 con 0x7fa4001613e0 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3ff7fe700 1 -- 172.21.15.88:0/4219702759 >> v1:172.21.15.94:6789/0 conn(0x7fa4001574b0 legacy=0x7fa400071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3ff7fe700 1 -- 172.21.15.88:0/4219702759 >> v1:172.21.15.88:6789/0 conn(0x7fa4001613e0 legacy=0x7fa400165ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.715+0000 7fa3ff7fe700 1 -- 172.21.15.88:0/4219702759 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4000c1630 con 0x7fa4000c1f70 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3ff7fe700 1 --2- 172.21.15.88:0/4219702759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa4000c5600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009850 tx=0x7fa3f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0a30cc07ece98b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fdffb700 1 -- 172.21.15.88:0/4219702759 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011830 con 0x7fa4000c1f70 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fdffb700 1 -- 172.21.15.88:0/4219702759 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f8011990 con 0x7fa4000c1f70 2024-09-13T18:09:05.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fdffb700 1 -- 172.21.15.88:0/4219702759 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8011d40 con 0x7fa4000c1f70 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- 172.21.15.88:0/4219702759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 msgr2=0x7fa4000c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 --2- 172.21.15.88:0/4219702759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa4000c5600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009850 tx=0x7fa3f8009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- 172.21.15.88:0/4219702759 shutdown_connections 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 --2- 172.21.15.88:0/4219702759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa4000c5600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- 172.21.15.88:0/4219702759 >> 172.21.15.88:0/4219702759 conn(0x7fa4000ca720 msgr2=0x7fa4000cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- 172.21.15.88:0/4219702759 shutdown_connections 2024-09-13T18:09:05.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- 172.21.15.88:0/4219702759 wait complete. 2024-09-13T18:09:05.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 Processor -- start 2024-09-13T18:09:05.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.719+0000 7fa3fffff700 1 -- start start 2024-09-13T18:09:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 0x7fa400149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4001613e0 0x7fa400149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40014a8c0 con 0x7fa4000c1f70 2024-09-13T18:09:05.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001f66c0 con 0x7fa4001574b0 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4001f69a0 con 0x7fa4001613e0 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:52010/0 (socket says 172.21.15.88:52010) 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 -- 172.21.15.88:0/2619353735 learned_addr learned my addr 172.21.15.88:0/2619353735 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fe7fc700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 0x7fa400149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3ff7fe700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4001613e0 0x7fa400149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 -- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4001613e0 msgr2=0x7fa400149d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4001613e0 0x7fa400149d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 -- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 msgr2=0x7fa400149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 0x7fa400149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 -- 172.21.15.88:0/2619353735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094b0 con 0x7fa4000c1f70 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fe7fc700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 0x7fa400149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3feffd700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c500 tx=0x7fa3f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00052d0 con 0x7fa4000c1f70 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0005430 con 0x7fa4000c1f70 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4001f6c80 con 0x7fa4000c1f70 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f00055a0 con 0x7fa4000c1f70 2024-09-13T18:09:05.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001f7240 con 0x7fa4000c1f70 2024-09-13T18:09:05.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.723+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4001f7460 con 0x7fa4000c1f70 2024-09-13T18:09:05.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.727+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fa3f00038e0 con 0x7fa4000c1f70 2024-09-13T18:09:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.727+0000 7fa3f77fe700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 0x7fa3e4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.727+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa3f0083660 con 0x7fa4000c1f70 2024-09-13T18:09:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.727+0000 7fa3fe7fc700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 0x7fa3e4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:05.733 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.727+0000 7fa3fe7fc700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 0x7fa3e4068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa4001565c0 tx=0x7fa3e8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:05.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.731+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fa3f00509e0 con 0x7fa4000c1f70 2024-09-13T18:09:05.969 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.963+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) v1 -- 0x7fa4001558d0 con 0x7fa4000c1f70 2024-09-13T18:09:05.970 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.963+0000 7fa3f77fe700 1 -- 172.21.15.88:0/2619353735 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) v1 ==== 57+0+0 (secure 0 0 0) 0x7fa3f0054000 con 0x7fa4000c1f70 2024-09-13T18:09:05.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 msgr2=0x7fa3e4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 0x7fa3e4068c20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa4001565c0 tx=0x7fa3e8009040 comp rx=0 tx=0).stop 2024-09-13T18:09:05.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 msgr2=0x7fa40014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:05.973 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa3f000c500 tx=0x7fa3f000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 shutdown_connections 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fa3e4066760 0x7fa3e4068c20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa4001613e0 0x7fa400149d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa4001574b0 0x7fa400149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 --2- 172.21.15.88:0/2619353735 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4000c1f70 0x7fa40014cd80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 >> 172.21.15.88:0/2619353735 conn(0x7fa4000ca720 msgr2=0x7fa400154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 shutdown_connections 2024-09-13T18:09:05.974 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:05.967+0000 7fa3fffff700 1 -- 172.21.15.88:0/2619353735 wait complete. 2024-09-13T18:09:05.988 INFO:tasks.mon_thrash.mon_thrasher:waiting for 10.0 secs before continuing thrashing 2024-09-13T18:09:12.541 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:09:12.541 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:09:12.542 INFO:tasks.workunit.client.0.smithi088.stdout: 2024-09-13T18:09:12.542 INFO:tasks.workunit.client.0.smithi088.stdout:iozone test complete. 2024-09-13T18:09:12.544 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T18:09:12.545 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T18:09:12.577 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-13T18:09:12.577 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T18:09:12.835 DEBUG:teuthology.parallel:result is None 2024-09-13T18:09:12.836 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:09:12.869 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T18:09:12.869 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-13T18:09:12.881 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-13T18:09:15.989 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:09:16.110 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.103+0000 7f43952cc700 1 Processor -- start 2024-09-13T18:09:16.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.103+0000 7f43952cc700 1 -- start start 2024-09-13T18:09:16.111 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f4390071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43900c18f0 con 0x7f439014fdb0 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43901560a0 con 0x7f4390159100 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4390159520 con 0x7f4390071720 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f439014fdb0 0x7f4390156530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43880/0 (socket says 172.21.15.88:43880) 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438ffff700 1 -- 172.21.15.88:0/1419923592 learned_addr learned my addr 172.21.15.88:0/1419923592 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:16.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f4390071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 645593861 0 0) 0x7f43900c18f0 con 0x7f439014fdb0 2024-09-13T18:09:16.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f437c0057e0 con 0x7f439014fdb0 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446785052 0 0) 0x7f43901560a0 con 0x7f4390159100 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43900c18f0 con 0x7f4390159100 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311846263 0 0) 0x7f437c0057e0 con 0x7f439014fdb0 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 msgr2=0x7f4390071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f4390071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 >> v1:172.21.15.94:6789/0 conn(0x7f4390159100 legacy=0x7f43900c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900c23a0 con 0x7f439014fdb0 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f4380001670 con 0x7f439014fdb0 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f4390071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 >> v1:172.21.15.88:6789/0 conn(0x7f439014fdb0 legacy=0x7f4390156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f437c005df0 0x7f437c0061d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f437c006a80 0x7f437c006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f437c007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390159520 con 0x7f437c005df0 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437c00dc40 con 0x7f437c006a80 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f437c00de00 con 0x7f4390071720 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438ffff700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f437c005df0 0x7f437c0061d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f437c007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43877fe700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f437c006a80 0x7f437c006f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 -- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f437c006a80 msgr2=0x7f437c006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f437c006a80 0x7f437c006f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 -- 172.21.15.88:0/1419923592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f437c005df0 msgr2=0x7f437c0061d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f437c005df0 0x7f437c0061d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 -- 172.21.15.88:0/1419923592 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4388009a70 con 0x7f4390071720 2024-09-13T18:09:16.117 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438ffff700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f437c005df0 0x7f437c0061d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f4394acb700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f437c007440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f438800e350 tx=0x7f437c007ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74ac6b8c74e1bc09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438800edf0 con 0x7f4390071720 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438800f040 con 0x7f4390071720 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f438f7fe700 1 -- 172.21.15.88:0/1419923592 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43880146a0 con 0x7f4390071720 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 -- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 msgr2=0x7f437c007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.107+0000 7f43952cc700 1 --2- 172.21.15.88:0/1419923592 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4390071720 0x7f437c007440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f438800e350 tx=0x7f437c007ab0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f4394acb700 1 -- 172.21.15.88:0/1419923592 reap_dead start 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- 172.21.15.88:0/1419923592 shutdown_connections 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- 172.21.15.88:0/1419923592 >> 172.21.15.88:0/1419923592 conn(0x7f43900ca720 msgr2=0x7f43900cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- 172.21.15.88:0/1419923592 shutdown_connections 2024-09-13T18:09:16.118 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- 172.21.15.88:0/1419923592 wait complete. 2024-09-13T18:09:16.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 Processor -- start 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- start start 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43900c5360 0x7f4390142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43900c57a0 0x7f4390142f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43900c2990 con 0x7f4390071720 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4390157600 con 0x7f43900c57a0 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43952cc700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4390143e30 con 0x7f43900c5360 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53024/0 (socket says 172.21.15.88:53024) 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 -- 172.21.15.88:0/3060252269 learned_addr learned my addr 172.21.15.88:0/3060252269 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:16.121 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f43877fe700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43900c5360 0x7f4390142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f4394acb700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43900c57a0 0x7f4390142f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 -- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43900c5360 msgr2=0x7f4390142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43900c5360 0x7f4390142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 -- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43900c57a0 msgr2=0x7f4390142f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43900c57a0 0x7f4390142f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.111+0000 7f438ffff700 1 -- 172.21.15.88:0/3060252269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4390156cf0 con 0x7f4390071720 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438ffff700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4380004f50 tx=0x7f4380006330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000a6a0 con 0x7f4390071720 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438000a800 con 0x7f4390071720 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438000ab70 con 0x7f4390071720 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439014cd60 con 0x7f4390071720 2024-09-13T18:09:16.122 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4390156fb0 con 0x7f4390071720 2024-09-13T18:09:16.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4390157740 con 0x7f4390071720 2024-09-13T18:09:16.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f438000acd0 con 0x7f4390071720 2024-09-13T18:09:16.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 0x7f4370068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.123 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.115+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4380084800 con 0x7f4390071720 2024-09-13T18:09:16.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.119+0000 7f43877fe700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 0x7f4370068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.119+0000 7f43877fe700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 0x7f4370068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4390142030 tx=0x7f4378009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.128 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.123+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4380051af0 con 0x7f4390071720 2024-09-13T18:09:16.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.331+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4390155d30 con 0x7f4390071720 2024-09-13T18:09:16.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f438d7fa700 1 -- 172.21.15.88:0/3060252269 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7f4380055110 con 0x7f4390071720 2024-09-13T18:09:16.339 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:16.339 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 msgr2=0x7f4370068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 0x7f4370068c20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4390142030 tx=0x7f4378009040 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 msgr2=0x7f43901438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4380004f50 tx=0x7f4380006330 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 shutdown_connections 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4370066760 0x7f4370068c20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f43900c5360 0x7f4390142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f43900c57a0 0x7f4390142f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 --2- 172.21.15.88:0/3060252269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4390071720 0x7f43901438f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 >> 172.21.15.88:0/3060252269 conn(0x7f43900ca720 msgr2=0x7f4390156530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 shutdown_connections 2024-09-13T18:09:16.342 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.335+0000 7f43952cc700 1 -- 172.21.15.88:0/3060252269 wait complete. 2024-09-13T18:09:16.343 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:09:16.355 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2024-09-13T18:09:16.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-13T18:09:16.463 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 Processor -- start 2024-09-13T18:09:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 -- start start 2024-09-13T18:09:16.464 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f13ac0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac0c1db0 con 0x7f13ac1613e0 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13ac160f50 con 0x7f13ac0c1f70 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13ab59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0c5b40 con 0x7f13ac1574b0 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a9d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f13ac1613e0 0x7f13ac071720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43884/0 (socket says 172.21.15.88:43884) 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a9d9b700 1 -- 172.21.15.88:0/854346983 learned_addr learned my addr 172.21.15.88:0/854346983 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aa59c700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f13ac0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672160165 0 0) 0x7f13a4001490 con 0x7f13ac1613e0 2024-09-13T18:09:16.465 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13980035d0 con 0x7f13ac1613e0 2024-09-13T18:09:16.467 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042157026 0 0) 0x7f13980035d0 con 0x7f13ac1613e0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 msgr2=0x7f13ac0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f13ac0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 >> v1:172.21.15.94:6789/0 conn(0x7f13ac0c1f70 legacy=0x7f13ac167ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac0c1630 con 0x7f13ac1613e0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f13a4001b80 con 0x7f13ac1613e0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 >> v1:172.21.15.88:6789/0 conn(0x7f13ac1613e0 legacy=0x7f13ac071720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f1398003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1398003fd0 0x7f1398004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1398004db0 0x7f1398005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac0c5b40 con 0x7f1398004db0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139800bba0 con 0x7f1398003fd0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139800bd60 con 0x7f13ac1574b0 2024-09-13T18:09:16.468 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aa59c700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f1398003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1398004db0 0x7f1398005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a9d9b700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1398003fd0 0x7f1398004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 -- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 msgr2=0x7f1398003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13ac1574b0 0x7f1398003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 -- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1398003fd0 msgr2=0x7f1398004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1398003fd0 0x7f1398004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 -- 172.21.15.88:0/854346983 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980035d0 con 0x7f1398004db0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13aad9d700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1398004db0 0x7f1398005230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0c2420 tx=0x7f13980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc785ea2936d95 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0052d0 con 0x7f1398004db0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c005430 con 0x7f1398004db0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.459+0000 7f13a959a700 1 -- 172.21.15.88:0/854346983 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0055a0 con 0x7f1398004db0 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- 172.21.15.88:0/854346983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1398004db0 msgr2=0x7f1398005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 --2- 172.21.15.88:0/854346983 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1398004db0 0x7f1398005230 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0c2420 tx=0x7f13980058a0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.469 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13aad9d700 1 -- 172.21.15.88:0/854346983 reap_dead start 2024-09-13T18:09:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- 172.21.15.88:0/854346983 shutdown_connections 2024-09-13T18:09:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- 172.21.15.88:0/854346983 >> 172.21.15.88:0/854346983 conn(0x7f13ac0ca720 msgr2=0x7f13ac0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- 172.21.15.88:0/854346983 shutdown_connections 2024-09-13T18:09:16.470 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- 172.21.15.88:0/854346983 wait complete. 2024-09-13T18:09:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 Processor -- start 2024-09-13T18:09:16.471 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- start start 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1398004db0 0x7f13ac14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13ac15eac0 0x7f13ac14a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac160760 con 0x7f13ac15ef00 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1e6550 con 0x7f13ac15eac0 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13ab59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13ac1e6db0 con 0x7f1398004db0 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.463+0000 7f13aad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53036/0 (socket says 172.21.15.88:53036) 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 -- 172.21.15.88:0/1766171398 learned_addr learned my addr 172.21.15.88:0/1766171398 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aa59c700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1398004db0 0x7f13ac14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a9d9b700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13ac15eac0 0x7f13ac14a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 -- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1398004db0 msgr2=0x7f13ac14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1398004db0 0x7f13ac14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.472 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 -- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13ac15eac0 msgr2=0x7f13ac14a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13ac15eac0 0x7f13ac14a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 -- 172.21.15.88:0/1766171398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac14c580 con 0x7f13ac15ef00 2024-09-13T18:09:16.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13aad9d700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f139c004000 tx=0x7f139c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c0055a0 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c0038a0 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13ac1e6760 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c003c30 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13ac160420 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ac157890 con 0x7f13ac15ef00 2024-09-13T18:09:16.474 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f139c007040 con 0x7f13ac15ef00 2024-09-13T18:09:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 0x7f138c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.467+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f139c084c40 con 0x7f13ac15ef00 2024-09-13T18:09:16.475 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.471+0000 7f13aa59c700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 0x7f138c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.476 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.471+0000 7f13aa59c700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 0x7f138c068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1394009c70 tx=0x7f1394009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.475+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f139c052080 con 0x7f13ac15ef00 2024-09-13T18:09:16.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.719+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) v1 -- 0x7f13ac1e6ef0 con 0x7f13ac15ef00 2024-09-13T18:09:16.726 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.719+0000 7f13a2ffd700 1 -- 172.21.15.88:0/1766171398 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) v1 ==== 61+0+1540 (secure 0 0 0) 0x7f139c02c080 con 0x7f13ac15ef00 2024-09-13T18:09:16.726 INFO:teuthology.orchestra.run.smithi088.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4540138322906710015","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"]},"monmap":{"epoch":1,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","modified":"2024-09-13T18:04:34.255927Z","created":"2024-09-13T18:04:34.255927Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3300","nonce":0},{"type":"v1","addr":"172.21.15.94:6789","nonce":0}]},"addr":"172.21.15.94:6789/0","public_addr":"172.21.15.94:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:3301","nonce":0},{"type":"v1","addr":"172.21.15.94:6790","nonce":0}]},"addr":"172.21.15.94:6790/0","public_addr":"172.21.15.94:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-13T18:09:16.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 msgr2=0x7f138c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 0x7f138c068bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1394009c70 tx=0x7f1394009240 comp rx=0 tx=0).stop 2024-09-13T18:09:16.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 msgr2=0x7f13ac14adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f139c004000 tx=0x7f139c001120 comp rx=0 tx=0).stop 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 shutdown_connections 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f138c066730 0x7f138c068bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13ac15ef00 0x7f13ac14adc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13ac15eac0 0x7f13ac14a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 --2- 172.21.15.88:0/1766171398 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1398004db0 0x7f13ac14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 >> 172.21.15.88:0/1766171398 conn(0x7f13ac0ca720 msgr2=0x7f13ac156150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 shutdown_connections 2024-09-13T18:09:16.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.723+0000 7f13ab59e700 1 -- 172.21.15.88:0/1766171398 wait complete. 2024-09-13T18:09:16.741 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2024-09-13T18:09:16.742 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-13T18:09:16.755 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-13T18:09:16.755 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:09:16.755 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:09:16.762 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:09:16.762 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:09:16.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:09:16.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 Processor -- start 2024-09-13T18:09:16.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 -- start start 2024-09-13T18:09:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff38006f6a0 0x7ff38006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3800c3e30 0x7ff3800c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38006dce0 con 0x7ff380150b30 2024-09-13T18:09:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38006e010 con 0x7ff3800c3e30 2024-09-13T18:09:16.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff385dad700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38006d140 con 0x7ff38006f6a0 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff3855ac700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3800c3e30 0x7ff3800c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff384dab700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff380150b30 0x7ff38006e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43894/0 (socket says 172.21.15.88:43894) 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff384dab700 1 -- 172.21.15.88:0/740610900 learned_addr learned my addr 172.21.15.88:0/740610900 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff37ffff700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff38006f6a0 0x7ff38006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff3855ac700 1 -- 172.21.15.88:0/740610900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff38006f6a0 msgr2=0x7ff38006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff3855ac700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff38006f6a0 0x7ff38006fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff3855ac700 1 -- 172.21.15.88:0/740610900 >> v1:172.21.15.88:6789/0 conn(0x7ff380150b30 legacy=0x7ff38006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff37f7fe700 1 -- 172.21.15.88:0/740610900 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482597746 0 0) 0x7ff38006dce0 con 0x7ff380150b30 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.927+0000 7ff3855ac700 1 -- 172.21.15.88:0/740610900 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38006bcb0 con 0x7ff3800c3e30 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff3855ac700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3800c3e30 0x7ff3800c42a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808c1b6d5a8b03e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff37f7fe700 1 -- 172.21.15.88:0/740610900 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37800e070 con 0x7ff3800c3e30 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff37f7fe700 1 -- 172.21.15.88:0/740610900 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37800bb20 con 0x7ff3800c3e30 2024-09-13T18:09:16.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff37f7fe700 1 -- 172.21.15.88:0/740610900 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378012430 con 0x7ff3800c3e30 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- 172.21.15.88:0/740610900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3800c3e30 msgr2=0x7ff3800c42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3800c3e30 0x7ff3800c42a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff378009d90 tx=0x7ff37800b330 comp rx=0 tx=0).stop 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- 172.21.15.88:0/740610900 shutdown_connections 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3800c3e30 0x7ff3800c42a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 --2- 172.21.15.88:0/740610900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff38006f6a0 0x7ff38006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.937 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- 172.21.15.88:0/740610900 >> 172.21.15.88:0/740610900 conn(0x7ff3800ca720 msgr2=0x7ff3800cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:16.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- 172.21.15.88:0/740610900 shutdown_connections 2024-09-13T18:09:16.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- 172.21.15.88:0/740610900 wait complete. 2024-09-13T18:09:16.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 Processor -- start 2024-09-13T18:09:16.938 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.931+0000 7ff385dad700 1 -- start start 2024-09-13T18:09:16.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3800c3e30 0x7ff380154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff380150b30 0x7ff38014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801f0540 con 0x7ff38006f6a0 2024-09-13T18:09:16.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801ef8c0 con 0x7ff3800c3e30 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3801efba0 con 0x7ff380150b30 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53046/0 (socket says 172.21.15.88:53046) 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 -- 172.21.15.88:0/3278142668 learned_addr learned my addr 172.21.15.88:0/3278142668 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff37ffff700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3800c3e30 0x7ff380154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff3855ac700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff380150b30 0x7ff38014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 -- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff380150b30 msgr2=0x7ff38014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff380150b30 0x7ff38014cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 -- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3800c3e30 msgr2=0x7ff380154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3800c3e30 0x7ff380154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 -- 172.21.15.88:0/3278142668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009a70 con 0x7ff38006f6a0 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff384dab700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c4e0 tx=0x7ff36800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368004ca0 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368004e20 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3801efe80 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368007310 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff380153230 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3801f0680 con 0x7ff38006f6a0 2024-09-13T18:09:16.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.935+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff368007470 con 0x7ff38006f6a0 2024-09-13T18:09:16.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.939+0000 7ff37d7fa700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:16.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.939+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff368083ef0 con 0x7ff38006f6a0 2024-09-13T18:09:16.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.939+0000 7ff37ffff700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:16.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.939+0000 7ff37ffff700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 0x7ff360068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff3801476e0 tx=0x7ff370008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:16.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:16.943+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3801f0680 con 0x7ff38006f6a0 2024-09-13T18:09:17.124 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.119+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3801f0680 con 0x7ff38006f6a0 2024-09-13T18:09:17.125 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.119+0000 7ff37d7fa700 1 -- 172.21.15.88:0/3278142668 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16646 (secure 0 0 0) 0x7ff3801f0680 con 0x7ff38006f6a0 2024-09-13T18:09:17.126 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:17.126 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:06:16.706465+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 msgr2=0x7ff360068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 0x7ff360068c20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff3801476e0 tx=0x7ff370008040 comp rx=0 tx=0).stop 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 msgr2=0x7ff380153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c4e0 tx=0x7ff36800c8a0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 shutdown_connections 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff360066760 0x7ff360068c20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff380150b30 0x7ff38014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3800c3e30 0x7ff380154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 --2- 172.21.15.88:0/3278142668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38006f6a0 0x7ff380153c30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 >> 172.21.15.88:0/3278142668 conn(0x7ff3800ca720 msgr2=0x7ff3800c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 shutdown_connections 2024-09-13T18:09:17.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.123+0000 7ff385dad700 1 -- 172.21.15.88:0/3278142668 wait complete. 2024-09-13T18:09:17.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:09:17.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:09:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 Processor -- start 2024-09-13T18:09:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 -- start start 2024-09-13T18:09:17.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd3e41531e0 0x7fd3e4159830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 0x7fd3e40c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3e40c4500 con 0x7fd3e40c4050 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3e41535c0 con 0x7fd3e41531e0 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3ea335700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e40c53b0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3e9b34700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd3e40c4050 0x7fd3e40cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43900/0 (socket says 172.21.15.88:43900) 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3e9b34700 1 -- 172.21.15.88:0/12090669 learned_addr learned my addr 172.21.15.88:0/12090669 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/12090669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 0x7fd3e40c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.251+0000 7fd3e9333700 1 --2- 172.21.15.88:0/12090669 >> v2:172.21.15.94:3300/0 conn(0x7fd3e41531e0 0x7fd3e4159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e3fff700 1 -- 172.21.15.88:0/12090669 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059420662 0 0) 0x7fd3e40c4500 con 0x7fd3e40c4050 2024-09-13T18:09:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e3fff700 1 -- 172.21.15.88:0/12090669 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3d00035d0 con 0x7fd3e40c4050 2024-09-13T18:09:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e8b32700 1 -- 172.21.15.88:0/12090669 >> v2:172.21.15.94:3300/0 conn(0x7fd3e41531e0 msgr2=0x7fd3e4159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:17.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/12090669 >> v2:172.21.15.94:3300/0 conn(0x7fd3e41531e0 0x7fd3e4159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e8b32700 1 -- 172.21.15.88:0/12090669 >> v1:172.21.15.88:6789/0 conn(0x7fd3e40c4050 legacy=0x7fd3e40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e8b32700 1 -- 172.21.15.88:0/12090669 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e40ca250 con 0x7fd3e406f2e0 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/12090669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 0x7fd3e40c3b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009d90 tx=0x7fd3cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b76acac4ad21b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e3fff700 1 -- 172.21.15.88:0/12090669 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00e070 con 0x7fd3e406f2e0 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e3fff700 1 -- 172.21.15.88:0/12090669 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00bb20 con 0x7fd3e406f2e0 2024-09-13T18:09:17.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3e3fff700 1 -- 172.21.15.88:0/12090669 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc00be90 con 0x7fd3e406f2e0 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 -- 172.21.15.88:0/12090669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 msgr2=0x7fd3e40c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 --2- 172.21.15.88:0/12090669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 0x7fd3e40c3b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc009d90 tx=0x7fd3cc00b330 comp rx=0 tx=0).stop 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 -- 172.21.15.88:0/12090669 shutdown_connections 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 --2- 172.21.15.88:0/12090669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e406f2e0 0x7fd3e40c3b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 --2- 172.21.15.88:0/12090669 >> v2:172.21.15.94:3300/0 conn(0x7fd3e41531e0 0x7fd3e4159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 -- 172.21.15.88:0/12090669 >> 172.21.15.88:0/12090669 conn(0x7fd3e4071590 msgr2=0x7fd3e40719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 -- 172.21.15.88:0/12090669 shutdown_connections 2024-09-13T18:09:17.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.255+0000 7fd3ea335700 1 -- 172.21.15.88:0/12090669 wait complete. 2024-09-13T18:09:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 Processor -- start 2024-09-13T18:09:17.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- start start 2024-09-13T18:09:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3e40c4050 0x7fd3e40cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 0x7fd3e41e2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41e33b0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e41e4560 con 0x7fd3e40c4050 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e4154930 con 0x7fd3e41531e0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53060/0 (socket says 172.21.15.88:53060) 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 -- 172.21.15.88:0/2291948939 learned_addr learned my addr 172.21.15.88:0/2291948939 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3e40c4050 0x7fd3e40cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9b34700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 0x7fd3e41e2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 -- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 msgr2=0x7fd3e41e2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 0x7fd3e41e2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 -- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3e40c4050 msgr2=0x7fd3e40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3e40c4050 0x7fd3e40cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 -- 172.21.15.88:0/2291948939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3cc009a70 con 0x7fd3e406f2e0 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9b34700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 0x7fd3e41e2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:17.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e9333700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400ea00 tx=0x7fd3d400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d4009720 con 0x7fd3e406f2e0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d400c850 con 0x7fd3e406f2e0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e40b30d0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d400cbc0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.259+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3e41e21a0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.263+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e40c9f70 con 0x7fd3e406f2e0 2024-09-13T18:09:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.263+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd3d400cd20 con 0x7fd3e406f2e0 2024-09-13T18:09:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.263+0000 7fd3e1ffb700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 0x7fd3c4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.269 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.263+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd3d4084aa0 con 0x7fd3e406f2e0 2024-09-13T18:09:17.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.263+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 0x7fd3c4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.271 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.267+0000 7fd3e8b32700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 0x7fd3c4068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc014040 tx=0x7fd3cc011000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.275+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd3d4051d70 con 0x7fd3e406f2e0 2024-09-13T18:09:17.444 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.439+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3e4150a90 con 0x7fd3e406f2e0 2024-09-13T18:09:17.445 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.439+0000 7fd3e1ffb700 1 -- 172.21.15.88:0/2291948939 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3d4021020 con 0x7fd3e406f2e0 2024-09-13T18:09:17.445 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 msgr2=0x7fd3c4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 0x7fd3c4068bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc014040 tx=0x7fd3cc011000 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 msgr2=0x7fd3e41434f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd3d400ea00 tx=0x7fd3d400ed10 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 shutdown_connections 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd3c4066730 0x7fd3c4068bf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd3e41531e0 0x7fd3e41e2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd3e40c4050 0x7fd3e40cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 --2- 172.21.15.88:0/2291948939 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd3e406f2e0 0x7fd3e41434f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 >> 172.21.15.88:0/2291948939 conn(0x7fd3e4071590 msgr2=0x7fd3e4150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 shutdown_connections 2024-09-13T18:09:17.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.443+0000 7fd3ea335700 1 -- 172.21.15.88:0/2291948939 wait complete. 2024-09-13T18:09:17.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:09:17.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 Processor -- start 2024-09-13T18:09:17.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 -- start start 2024-09-13T18:09:17.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c071b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5d6c159110 0x7f5d6c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d6c06d780 0x7f5d6c066090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c0c79f0 con 0x7f5d6c06d780 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d6c06f9c0 con 0x7f5d6c159110 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d73661700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c0720c0 con 0x7f5d6c158d30 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d6c06d780 0x7f5d6c066090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5d6c06d780 0x7f5d6c066090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53064/0 (socket says 172.21.15.88:53064) 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 -- 172.21.15.88:0/1087301839 learned_addr learned my addr 172.21.15.88:0/1087301839 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d70bfc700 1 --2- 172.21.15.88:0/1087301839 >> v2:172.21.15.94:3300/0 conn(0x7f5d6c159110 0x7f5d6c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d713fd700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 -- 172.21.15.88:0/1087301839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 msgr2=0x7f5d6c071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 -- 172.21.15.88:0/1087301839 >> v2:172.21.15.94:3300/0 conn(0x7f5d6c159110 msgr2=0x7f5d6c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 --2- 172.21.15.88:0/1087301839 >> v2:172.21.15.94:3300/0 conn(0x7f5d6c159110 0x7f5d6c06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 -- 172.21.15.88:0/1087301839 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c0c6e60 con 0x7f5d6c06d780 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d71bfe700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c066090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c06b8a0 tx=0x7f5d6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e65775ab56978bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d5ffff700 1 -- 172.21.15.88:0/1087301839 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400e070 con 0x7f5d6c06d780 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d5ffff700 1 -- 172.21.15.88:0/1087301839 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400b8d0 con 0x7f5d6c06d780 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.579+0000 7f5d5ffff700 1 -- 172.21.15.88:0/1087301839 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400bc80 con 0x7f5d6c06d780 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/1087301839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 msgr2=0x7f5d6c066090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c066090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c06b8a0 tx=0x7f5d6400b330 comp rx=0 tx=0).stop 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/1087301839 shutdown_connections 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c066090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- 172.21.15.88:0/1087301839 >> v2:172.21.15.94:3300/0 conn(0x7f5d6c159110 0x7f5d6c06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- 172.21.15.88:0/1087301839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/1087301839 >> 172.21.15.88:0/1087301839 conn(0x7f5d6c0cb0f0 msgr2=0x7f5d6c0cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/1087301839 shutdown_connections 2024-09-13T18:09:17.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/1087301839 wait complete. 2024-09-13T18:09:17.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 Processor -- start 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- start start 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d6c159110 0x7f5d6c154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1517e0 con 0x7f5d6c06d780 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c154b50 con 0x7f5d6c159110 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6c1531b0 con 0x7f5d6c158d30 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53068/0 (socket says 172.21.15.88:53068) 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 -- 172.21.15.88:0/3004113766 learned_addr learned my addr 172.21.15.88:0/3004113766 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d71bfe700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d6c159110 0x7f5d6c154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d70bfc700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 -- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 msgr2=0x7f5d6c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 -- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d6c159110 msgr2=0x7f5d6c154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d6c159110 0x7f5d6c154fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 -- 172.21.15.88:0/3004113766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d64009b30 con 0x7f5d6c06d780 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d713fd700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000e7c0 tx=0x7f5d6000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60013680 con 0x7f5d6c06d780 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d600137e0 con 0x7f5d6c06d780 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6c1edda0 con 0x7f5d6c06d780 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60013b90 con 0x7f5d6c06d780 2024-09-13T18:09:17.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.583+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6c152f10 con 0x7f5d6c06d780 2024-09-13T18:09:17.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.587+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d6c0c4c90 con 0x7f5d6c06d780 2024-09-13T18:09:17.593 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.587+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5d60013cf0 con 0x7f5d6c06d780 2024-09-13T18:09:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.587+0000 7f5d5dffb700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 0x7f5d50068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.587+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5d60084310 con 0x7f5d6c06d780 2024-09-13T18:09:17.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.587+0000 7f5d70bfc700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 0x7f5d50068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.591+0000 7f5d70bfc700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 0x7f5d50068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c155c00 tx=0x7f5d68009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.595+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5d60051600 con 0x7f5d6c06d780 2024-09-13T18:09:17.776 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.771+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d6c0c6a00 con 0x7f5d6c06d780 2024-09-13T18:09:17.777 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.771+0000 7f5d5dffb700 1 -- 172.21.15.88:0/3004113766 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d60054c20 con 0x7f5d6c06d780 2024-09-13T18:09:17.777 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:09:17.781 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 msgr2=0x7f5d50068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 0x7f5d50068bf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c155c00 tx=0x7f5d68009240 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 msgr2=0x7f5d6c155e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d6000e7c0 tx=0x7f5d6000ead0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 shutdown_connections 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5d50066730 0x7f5d50068bf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5d6c158d30 0x7f5d6c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5d6c159110 0x7f5d6c154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 --2- 172.21.15.88:0/3004113766 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5d6c06d780 0x7f5d6c155e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 >> 172.21.15.88:0/3004113766 conn(0x7f5d6c0cb0f0 msgr2=0x7f5d6c070920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 shutdown_connections 2024-09-13T18:09:17.782 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.775+0000 7f5d73661700 1 -- 172.21.15.88:0/3004113766 wait complete. 2024-09-13T18:09:17.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:09:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 Processor -- start 2024-09-13T18:09:17.921 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 -- start start 2024-09-13T18:09:17.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f22e8071760 0x7f22e80722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e815e310 con 0x7f22e8071b40 2024-09-13T18:09:17.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e815d4b0 con 0x7f22e8071760 2024-09-13T18:09:17.922 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22eeb2b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e815d790 con 0x7f22e80c6ba0 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22edb29700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f22e8071760 0x7f22e80722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:37750/0 (socket says 172.21.15.88:37750) 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 -- 172.21.15.88:0/1852800650 learned_addr learned my addr 172.21.15.88:0/1852800650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 -- 172.21.15.88:0/1852800650 >> v2:172.21.15.94:3300/0 conn(0x7f22e8071760 msgr2=0x7f22e80722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 --2- 172.21.15.88:0/1852800650 >> v2:172.21.15.94:3300/0 conn(0x7f22e8071760 0x7f22e80722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 -- 172.21.15.88:0/1852800650 >> v1:172.21.15.94:6789/0 conn(0x7f22e8071b40 legacy=0x7f22e8157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 -- 172.21.15.88:0/1852800650 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e815da70 con 0x7f22e80c6ba0 2024-09-13T18:09:17.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.915+0000 7f22ee32a700 1 --2- 172.21.15.88:0/1852800650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009e50 tx=0x7f22d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10601839e82d0137 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22ecb27700 1 -- 172.21.15.88:0/1852800650 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800e070 con 0x7f22e80c6ba0 2024-09-13T18:09:17.924 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22ecb27700 1 -- 172.21.15.88:0/1852800650 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d800b910 con 0x7f22e80c6ba0 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22ecb27700 1 -- 172.21.15.88:0/1852800650 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800bcc0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1852800650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 msgr2=0x7f22e80c2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1852800650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22d8009e50 tx=0x7f22d800b330 comp rx=0 tx=0).stop 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1852800650 shutdown_connections 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1852800650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e80c6ba0 0x7f22e80c2ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1852800650 >> v2:172.21.15.94:3300/0 conn(0x7f22e8071760 0x7f22e80722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1852800650 >> 172.21.15.88:0/1852800650 conn(0x7f22e80c7120 msgr2=0x7f22e80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1852800650 shutdown_connections 2024-09-13T18:09:17.925 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1852800650 wait complete. 2024-09-13T18:09:17.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 Processor -- start 2024-09-13T18:09:17.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.919+0000 7f22eeb2b700 1 -- start start 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e8071760 0x7f22e81f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22e8071b40 0x7f22e815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e80c5db0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81f6fa0 con 0x7f22e8071b40 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81486c0 con 0x7f22e8071760 2024-09-13T18:09:17.928 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53070/0 (socket says 172.21.15.88:53070) 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 -- 172.21.15.88:0/1803029470 learned_addr learned my addr 172.21.15.88:0/1803029470 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22edb29700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e8071760 0x7f22e81f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ed328700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22e8071b40 0x7f22e815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 -- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e8071760 msgr2=0x7f22e81f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e8071760 0x7f22e81f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 -- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22e8071b40 msgr2=0x7f22e815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22e8071b40 0x7f22e815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 -- 172.21.15.88:0/1803029470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8009b30 con 0x7f22e80c6ba0 2024-09-13T18:09:17.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22ee32a700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22e80c2820 tx=0x7f22d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8004800 con 0x7f22e80c6ba0 2024-09-13T18:09:17.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80099b0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e8148ed0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d801c650 con 0x7f22e80c6ba0 2024-09-13T18:09:17.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e81f2d10 con 0x7f22e80c6ba0 2024-09-13T18:09:17.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.923+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e81f2ae0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.927+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f22d801c7b0 con 0x7f22e80c6ba0 2024-09-13T18:09:17.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.927+0000 7f22e67fc700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 0x7f22d4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:17.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.927+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f22d8085a00 con 0x7f22e80c6ba0 2024-09-13T18:09:17.932 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.927+0000 7f22edb29700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 0x7f22d4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:17.933 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.927+0000 7f22edb29700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 0x7f22d4068c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009b50 tx=0x7f22e0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:17.944 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:17.939+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f22e81f2ae0 con 0x7f22e80c6ba0 2024-09-13T18:09:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.111+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f22e8156360 con 0x7f22e80c6ba0 2024-09-13T18:09:18.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.111+0000 7f22e67fc700 1 -- 172.21.15.88:0/1803029470 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f22d8052c60 con 0x7f22e80c6ba0 2024-09-13T18:09:18.117 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:09:18.119 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 msgr2=0x7f22d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 0x7f22d4068c20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009b50 tx=0x7f22e0009240 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 msgr2=0x7f22e81f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f22e80c2820 tx=0x7f22d8004af0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 shutdown_connections 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f22d4066760 0x7f22d4068c20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22e80c6ba0 0x7f22e81f31a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22e8071b40 0x7f22e815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 --2- 172.21.15.88:0/1803029470 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f22e8071760 0x7f22e81f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 >> 172.21.15.88:0/1803029470 conn(0x7f22e80c7120 msgr2=0x7f22e8157010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 shutdown_connections 2024-09-13T18:09:18.120 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.115+0000 7f22eeb2b700 1 -- 172.21.15.88:0/1803029470 wait complete. 2024-09-13T18:09:18.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:09:18.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 Processor -- start 2024-09-13T18:09:18.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- start start 2024-09-13T18:09:18.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f722004bfd0 0x7f72200e6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f72200dc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7220005b00 con 0x7f72200e6320 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7220035710 con 0x7f722004bfd0 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7220045850 con 0x7f72200e6c40 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f722004bfd0 0x7f72200e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f722004bfd0 0x7f72200e6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53072/0 (socket says 172.21.15.88:53072) 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 -- 172.21.15.88:0/2529064088 learned_addr learned my addr 172.21.15.88:0/2529064088 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722ce98700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f72200dc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 -- 172.21.15.88:0/2529064088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 msgr2=0x7f72200dc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f72200dc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 -- 172.21.15.88:0/2529064088 >> v1:172.21.15.94:6789/0 conn(0x7f72200e6320 legacy=0x7f7220045ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 -- 172.21.15.88:0/2529064088 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72200e3560 con 0x7f722004bfd0 2024-09-13T18:09:18.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f72277fe700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e6700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7228068e70 tx=0x7f722804f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631018c5df55e78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f7226ffd700 1 -- 172.21.15.88:0/2529064088 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280675d0 con 0x7f722004bfd0 2024-09-13T18:09:18.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f7226ffd700 1 -- 172.21.15.88:0/2529064088 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228067730 con 0x7f722004bfd0 2024-09-13T18:09:18.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f7226ffd700 1 -- 172.21.15.88:0/2529064088 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228068420 con 0x7f722004bfd0 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- 172.21.15.88:0/2529064088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 msgr2=0x7f72200e6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e6700 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7228068e70 tx=0x7f722804f710 comp rx=0 tx=0).stop 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- 172.21.15.88:0/2529064088 shutdown_connections 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f72200dc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 --2- 172.21.15.88:0/2529064088 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e6700 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- 172.21.15.88:0/2529064088 >> 172.21.15.88:0/2529064088 conn(0x7f722004fd00 msgr2=0x7f7220050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- 172.21.15.88:0/2529064088 shutdown_connections 2024-09-13T18:09:18.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.239+0000 7f722d699700 1 -- 172.21.15.88:0/2529064088 wait complete. 2024-09-13T18:09:18.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 Processor -- start 2024-09-13T18:09:18.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 -- start start 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72200e6320 0x7f72200d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f722004ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72200d0990 con 0x7f722004bfd0 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72200d4190 con 0x7f72200e6320 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722d699700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f722004dcf0 con 0x7f72200e6c40 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53078/0 (socket says 172.21.15.88:53078) 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 -- 172.21.15.88:0/1618063055 learned_addr learned my addr 172.21.15.88:0/1618063055 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:18.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f72277fe700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72200e6320 0x7f72200d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f722ce98700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f722004ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 -- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 msgr2=0x7f722004ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f722004ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 -- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72200e6320 msgr2=0x7f72200d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72200e6320 0x7f72200d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 -- 172.21.15.88:0/1618063055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7220179020 con 0x7f722004bfd0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7227fff700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f721400c530 tx=0x7f721400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.243+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140052d0 con 0x7f722004bfd0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7220179290 con 0x7f722004bfd0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7214005430 con 0x7f722004bfd0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f722004e220 con 0x7f722004bfd0 2024-09-13T18:09:18.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72140055a0 con 0x7f722004bfd0 2024-09-13T18:09:18.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72200454e0 con 0x7f722004bfd0 2024-09-13T18:09:18.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f72140036a0 con 0x7f722004bfd0 2024-09-13T18:09:18.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f7224ff9700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f72140833c0 con 0x7f722004bfd0 2024-09-13T18:09:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f72277fe700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.254 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.247+0000 7f72277fe700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 0x7f720c068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f722004d880 tx=0x7f722808d000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.255+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f72140505a0 con 0x7f722004bfd0 2024-09-13T18:09:18.446 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.439+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72200e0520 con 0x7f722004bfd0 2024-09-13T18:09:18.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.439+0000 7f7224ff9700 1 -- 172.21.15.88:0/1618063055 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7214053bc0 con 0x7f722004bfd0 2024-09-13T18:09:18.449 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 msgr2=0x7f720c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 0x7f720c068bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f722004d880 tx=0x7f722808d000 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 msgr2=0x7f72200e4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f721400c530 tx=0x7f721400c840 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 shutdown_connections 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f720c066730 0x7f720c068bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f72200e6c40 0x7f722004ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72200e6320 0x7f72200d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 --2- 172.21.15.88:0/1618063055 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f722004bfd0 0x7f72200e4070 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 >> 172.21.15.88:0/1618063055 conn(0x7f722004fd00 msgr2=0x7f72200e2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 shutdown_connections 2024-09-13T18:09:18.450 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.443+0000 7f722d699700 1 -- 172.21.15.88:0/1618063055 wait complete. 2024-09-13T18:09:18.451 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-09-13T18:09:18.462 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-09-13T18:09:18.462 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:09:18.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:09:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 Processor -- start 2024-09-13T18:09:18.628 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 -- start start 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c89c0 0x7fdf20158da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf20152be0 0x7fdf20153090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf200c61a0 con 0x7fdf200c8da0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2015cb60 con 0x7fdf20152be0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2015ce40 con 0x7fdf200c89c0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdf20152be0 0x7fdf20153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdf200c8da0 0x7fdf2015c390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43906/0 (socket says 172.21.15.88:43906) 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1f7fe700 1 -- 172.21.15.88:0/2473846074 learned_addr learned my addr 172.21.15.88:0/2473846074 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1ffff700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c89c0 0x7fdf20158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1effd700 1 -- 172.21.15.88:0/2473846074 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993355576 0 0) 0x7fdf200c61a0 con 0x7fdf200c8da0 2024-09-13T18:09:18.630 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1effd700 1 -- 172.21.15.88:0/2473846074 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf000035d0 con 0x7fdf200c8da0 2024-09-13T18:09:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2473846074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c89c0 msgr2=0x7fdf20158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c89c0 0x7fdf20158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2473846074 >> v1:172.21.15.88:6789/0 conn(0x7fdf200c8da0 legacy=0x7fdf2015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2473846074 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2015d120 con 0x7fdf20152be0 2024-09-13T18:09:18.631 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf24d2e700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf20153090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009850 tx=0x7fdf10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e62304ee71bbad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1effd700 1 -- 172.21.15.88:0/2473846074 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011830 con 0x7fdf20152be0 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1effd700 1 -- 172.21.15.88:0/2473846074 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf10011990 con 0x7fdf20152be0 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf1effd700 1 -- 172.21.15.88:0/2473846074 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011d40 con 0x7fdf20152be0 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 -- 172.21.15.88:0/2473846074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 msgr2=0x7fdf20153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.623+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf20153090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdf10009850 tx=0x7fdf10009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- 172.21.15.88:0/2473846074 shutdown_connections 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf20153090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2473846074 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c89c0 0x7fdf20158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.632 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- 172.21.15.88:0/2473846074 >> 172.21.15.88:0/2473846074 conn(0x7fdf2006a820 msgr2=0x7fdf2006ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- 172.21.15.88:0/2473846074 shutdown_connections 2024-09-13T18:09:18.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- 172.21.15.88:0/2473846074 wait complete. 2024-09-13T18:09:18.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 Processor -- start 2024-09-13T18:09:18.633 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- start start 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf200c89c0 0x7fdf201f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c8da0 0x7fdf200c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf20155740 con 0x7fdf20152be0 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf201f2550 con 0x7fdf200c89c0 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf2552f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2014ed50 con 0x7fdf200c8da0 2024-09-13T18:09:18.634 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53094/0 (socket says 172.21.15.88:53094) 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2635420934 learned_addr learned my addr 172.21.15.88:0/2635420934 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf1f7fe700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c8da0 0x7fdf200c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf1ffff700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf200c89c0 0x7fdf201f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c8da0 msgr2=0x7fdf200c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.635 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c8da0 0x7fdf200c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf200c89c0 msgr2=0x7fdf201f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.627+0000 7fdf24d2e700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf200c89c0 0x7fdf201f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf24d2e700 1 -- 172.21.15.88:0/2635420934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100094b0 con 0x7fdf20152be0 2024-09-13T18:09:18.636 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf24d2e700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf200c92a0 tx=0x7fdf10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10004300 con 0x7fdf20152be0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1001f070 con 0x7fdf20152be0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf201eedd0 con 0x7fdf20152be0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf100036c0 con 0x7fdf20152be0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf200c4930 con 0x7fdf20152be0 2024-09-13T18:09:18.637 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf201f26e0 con 0x7fdf20152be0 2024-09-13T18:09:18.638 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.631+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fdf10021030 con 0x7fdf20152be0 2024-09-13T18:09:18.639 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.635+0000 7fdf1cff9700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.635+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdf10085360 con 0x7fdf20152be0 2024-09-13T18:09:18.640 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.635+0000 7fdf1ffff700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.641 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.635+0000 7fdf1ffff700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 0x7fdf04068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009b50 tx=0x7fdf08009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.646 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.639+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fdf100528b0 con 0x7fdf20152be0 2024-09-13T18:09:18.820 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.815+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf20158da0 con 0x7fdf20152be0 2024-09-13T18:09:18.822 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.815+0000 7fdf1cff9700 1 -- 172.21.15.88:0/2635420934 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fdf10055ed0 con 0x7fdf20152be0 2024-09-13T18:09:18.822 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:18.822 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:06:16.706465+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 msgr2=0x7fdf04068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 0x7fdf04068bf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009b50 tx=0x7fdf08009240 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 msgr2=0x7fdf200c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdf200c92a0 tx=0x7fdf10004770 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 shutdown_connections 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fdf04066730 0x7fdf04068bf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdf200c8da0 0x7fdf200c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf20152be0 0x7fdf200c5640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 --2- 172.21.15.88:0/2635420934 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdf200c89c0 0x7fdf201f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.825 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 >> 172.21.15.88:0/2635420934 conn(0x7fdf2006a820 msgr2=0x7fdf200c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 shutdown_connections 2024-09-13T18:09:18.826 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.819+0000 7fdf2552f700 1 -- 172.21.15.88:0/2635420934 wait complete. 2024-09-13T18:09:18.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:05:19.011922+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:05:24.919545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:05:25.460502+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:09:18.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:09:18.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.947+0000 7f62df912700 1 Processor -- start 2024-09-13T18:09:18.955 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- start start 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d814fb00 0x7f62d806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f62d806c4d0 0x7f62d8156b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d806ca50 con 0x7f62d806feb0 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d814fee0 con 0x7f62d814fb00 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d806cd30 con 0x7f62d806c4d0 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d814fb00 0x7f62d806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.958 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f62d814fb00 0x7f62d806ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53102/0 (socket says 172.21.15.88:53102) 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dcead700 1 --2- 172.21.15.88:0/4086354056 >> v2:172.21.15.94:3300/0 conn(0x7f62d806c4d0 0x7f62d8156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 -- 172.21.15.88:0/4086354056 learned_addr learned my addr 172.21.15.88:0/4086354056 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 -- 172.21.15.88:0/4086354056 >> v2:172.21.15.94:3300/0 conn(0x7f62d806c4d0 msgr2=0x7f62d8156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62cffff700 1 -- 172.21.15.88:0/4086354056 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554887484 0 0) 0x7f62d806ca50 con 0x7f62d806feb0 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4086354056 >> v2:172.21.15.94:3300/0 conn(0x7f62d806c4d0 0x7f62d8156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 -- 172.21.15.88:0/4086354056 >> v1:172.21.15.94:6789/0 conn(0x7f62d806feb0 legacy=0x7f62d8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 -- 172.21.15.88:0/4086354056 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d806d010 con 0x7f62d814fb00 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4086354056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d814fb00 0x7f62d806ddd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62d8067060 tx=0x7f62c800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5aa70f21b3b344 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62cffff700 1 -- 172.21.15.88:0/4086354056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c800dd30 con 0x7f62d814fb00 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62cffff700 1 -- 172.21.15.88:0/4086354056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c800de90 con 0x7f62d814fb00 2024-09-13T18:09:18.959 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62cffff700 1 -- 172.21.15.88:0/4086354056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8010690 con 0x7f62d814fb00 2024-09-13T18:09:18.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- 172.21.15.88:0/4086354056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d814fb00 msgr2=0x7f62d806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 --2- 172.21.15.88:0/4086354056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d814fb00 0x7f62d806ddd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62d8067060 tx=0x7f62c800be90 comp rx=0 tx=0).stop 2024-09-13T18:09:18.962 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- 172.21.15.88:0/4086354056 shutdown_connections 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 --2- 172.21.15.88:0/4086354056 >> v2:172.21.15.94:3300/0 conn(0x7f62d806c4d0 0x7f62d8156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 --2- 172.21.15.88:0/4086354056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d814fb00 0x7f62d806ddd0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- 172.21.15.88:0/4086354056 >> 172.21.15.88:0/4086354056 conn(0x7f62d80c7320 msgr2=0x7f62d80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- 172.21.15.88:0/4086354056 shutdown_connections 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.951+0000 7f62df912700 1 -- 172.21.15.88:0/4086354056 wait complete. 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 Processor -- start 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- start start 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 0x7f62d81ee920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.963 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 0x7f62d80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d81501b0 con 0x7f62d806feb0 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d81f1e90 con 0x7f62d806c4d0 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c87c0 con 0x7f62d814fb00 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53118/0 (socket says 172.21.15.88:53118) 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 -- 172.21.15.88:0/4288902159 learned_addr learned my addr 172.21.15.88:0/4288902159 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 0x7f62d81ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62ddeaf700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 0x7f62d80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 -- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 msgr2=0x7f62d80ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 0x7f62d80ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 -- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 msgr2=0x7f62d81ee920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:18.964 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 0x7f62d81ee920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 -- 172.21.15.88:0/4288902159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c800b810 con 0x7f62d806feb0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62ddeaf700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 0x7f62d80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 0x7f62d81ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62dcead700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62d400e9d0 tx=0x7f62d400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4009720 con 0x7f62d806feb0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400c850 con 0x7f62d806feb0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400cbc0 con 0x7f62d806feb0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80c8aa0 con 0x7f62d806feb0 2024-09-13T18:09:18.965 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.955+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d81f2130 con 0x7f62d806feb0 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d806e920 con 0x7f62d806feb0 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f62d400cd20 con 0x7f62d806feb0 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62cdffb700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 0x7f62bc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f62d4084360 con 0x7f62d806feb0 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 0x7f62bc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:18.966 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.959+0000 7f62dd6ae700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 0x7f62bc068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62c800bed0 tx=0x7f62c8013000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:18.972 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:18.967+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f62d40515c0 con 0x7f62d806feb0 2024-09-13T18:09:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62d8070810 con 0x7f62d806feb0 2024-09-13T18:09:19.148 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62cdffb700 1 -- 172.21.15.88:0/4288902159 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62d4054be0 con 0x7f62d806feb0 2024-09-13T18:09:19.148 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-09-13T18:09:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 msgr2=0x7f62bc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 0x7f62bc068c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f62c800bed0 tx=0x7f62c8013000 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 msgr2=0x7f62d81f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62d400e9d0 tx=0x7f62d400ed90 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 shutdown_connections 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f62bc066760 0x7f62bc068c20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62d814fb00 0x7f62d80ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f62d806feb0 0x7f62d81f2930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.143+0000 7f62df912700 1 --2- 172.21.15.88:0/4288902159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62d806c4d0 0x7f62d81ee920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.147+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 >> 172.21.15.88:0/4288902159 conn(0x7f62d80c7320 msgr2=0x7f62d8157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.147+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 shutdown_connections 2024-09-13T18:09:19.153 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.147+0000 7f62df912700 1 -- 172.21.15.88:0/4288902159 wait complete. 2024-09-13T18:09:19.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:09:19.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.275+0000 7fb96d241700 1 Processor -- start 2024-09-13T18:09:19.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.275+0000 7fb96d241700 1 -- start start 2024-09-13T18:09:19.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 0x7fb9680c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96815a0b0 con 0x7fb9680ca6b0 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9680cafd0 con 0x7fb9680caad0 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681590e0 con 0x7fb968153330 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb9677fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb9680ca6b0 0x7fb96806eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43918/0 (socket says 172.21.15.88:43918) 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb9677fe700 1 -- 172.21.15.88:0/2191069310 learned_addr learned my addr 172.21.15.88:0/2191069310 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:19.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb967fff700 1 --2- 172.21.15.88:0/2191069310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 0x7fb9680c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.287 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795654149 0 0) 0x7fb96815a0b0 con 0x7fb9680ca6b0 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9500035d0 con 0x7fb9680ca6b0 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514000928 0 0) 0x7fb9680cafd0 con 0x7fb9680caad0 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96815a0b0 con 0x7fb9680caad0 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb967fff700 1 -- 172.21.15.88:0/2191069310 >> v1:172.21.15.94:6789/0 conn(0x7fb9680caad0 legacy=0x7fb9680cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb967fff700 1 -- 172.21.15.88:0/2191069310 >> v1:172.21.15.88:6789/0 conn(0x7fb9680ca6b0 legacy=0x7fb96806eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb967fff700 1 -- 172.21.15.88:0/2191069310 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9681592f0 con 0x7fb968153330 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb967fff700 1 --2- 172.21.15.88:0/2191069310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 0x7fb9680c3c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb958009880 tx=0x7fb958009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e00d07376e7abe7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958011830 con 0x7fb968153330 2024-09-13T18:09:19.288 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb958011990 con 0x7fb968153330 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb966ffd700 1 -- 172.21.15.88:0/2191069310 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb958011d20 con 0x7fb968153330 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- 172.21.15.88:0/2191069310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 msgr2=0x7fb9680c3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 --2- 172.21.15.88:0/2191069310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 0x7fb9680c3c60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb958009880 tx=0x7fb958009b90 comp rx=0 tx=0).stop 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- 172.21.15.88:0/2191069310 shutdown_connections 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 --2- 172.21.15.88:0/2191069310 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb968153330 0x7fb9680c3c60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- 172.21.15.88:0/2191069310 >> 172.21.15.88:0/2191069310 conn(0x7fb968071c30 msgr2=0x7fb968066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- 172.21.15.88:0/2191069310 shutdown_connections 2024-09-13T18:09:19.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.279+0000 7fb96d241700 1 -- 172.21.15.88:0/2191069310 wait complete. 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 Processor -- start 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 -- start start 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 0x7fb9681ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb968153330 0x7fb9681f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681eef30 con 0x7fb9680caad0 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681f2c40 con 0x7fb968153330 2024-09-13T18:09:19.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96d241700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9681f2f20 con 0x7fb9680ca6b0 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53120/0 (socket says 172.21.15.88:53120) 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 -- 172.21.15.88:0/3234155977 learned_addr learned my addr 172.21.15.88:0/3234155977 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb967fff700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 0x7fb9681ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb96ca40700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb968153330 0x7fb9681f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 -- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 msgr2=0x7fb9681ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 0x7fb9681ef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 -- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb968153330 msgr2=0x7fb9681f2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb968153330 0x7fb9681f2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb9677fe700 1 -- 172.21.15.88:0/3234155977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580094b0 con 0x7fb9680caad0 2024-09-13T18:09:19.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.283+0000 7fb967fff700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 0x7fb9681ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb9677fe700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c4d0 tx=0x7fb95c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c005d90 con 0x7fb9680caad0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0070d0 con 0x7fb9680caad0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9681ef1d0 con 0x7fb9680caad0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c007460 con 0x7fb9680caad0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9681f3200 con 0x7fb9680caad0 2024-09-13T18:09:19.294 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb968153710 con 0x7fb9680caad0 2024-09-13T18:09:19.295 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.287+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb95c0075c0 con 0x7fb9680caad0 2024-09-13T18:09:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.291+0000 7fb964ff9700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 0x7fb954068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.291+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb95c0837a0 con 0x7fb9680caad0 2024-09-13T18:09:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.291+0000 7fb967fff700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 0x7fb954068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.296 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.291+0000 7fb967fff700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 0x7fb954068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb9580090b0 tx=0x7fb95801c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.302 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.295+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb95c050a00 con 0x7fb9680caad0 2024-09-13T18:09:19.477 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.471+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb968066ed0 con 0x7fb9680caad0 2024-09-13T18:09:19.478 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.471+0000 7fb964ff9700 1 -- 172.21.15.88:0/3234155977 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb95c017020 con 0x7fb9680caad0 2024-09-13T18:09:19.478 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 msgr2=0x7fb954068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 0x7fb954068bf0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb9580090b0 tx=0x7fb95801c040 comp rx=0 tx=0).stop 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 msgr2=0x7fb9680cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00c4d0 tx=0x7fb95c00c890 comp rx=0 tx=0).stop 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 shutdown_connections 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb954066730 0x7fb954068bf0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb968153330 0x7fb9681f2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb9680caad0 0x7fb9680cd430 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.481 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 --2- 172.21.15.88:0/3234155977 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9680ca6b0 0x7fb9681ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 >> 172.21.15.88:0/3234155977 conn(0x7fb968071c30 msgr2=0x7fb9680b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 shutdown_connections 2024-09-13T18:09:19.482 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.475+0000 7fb96d241700 1 -- 172.21.15.88:0/3234155977 wait complete. 2024-09-13T18:09:19.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:09:19.610 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.603+0000 7f4071952700 1 Processor -- start 2024-09-13T18:09:19.611 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.603+0000 7f4071952700 1 -- start start 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f406c0c6780 0x7f406c14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0c2760 con 0x7f406c0c7d20 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c0c29b0 con 0x7f406c0c63a0 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c0c2c90 con 0x7f406c0c6780 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f406c0c7d20 0x7f406c14f7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43930/0 (socket says 172.21.15.88:43930) 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406bfff700 1 -- 172.21.15.88:0/2016623039 learned_addr learned my addr 172.21.15.88:0/2016623039 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:19.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071151700 1 --2- 172.21.15.88:0/2016623039 >> v2:172.21.15.94:3300/0 conn(0x7f406c0c6780 0x7f406c14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621219888 0 0) 0x7f406c0c2760 con 0x7f406c0c7d20 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40580035d0 con 0x7f406c0c7d20 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922464479 0 0) 0x7f406c0c29b0 con 0x7f406c0c63a0 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f406c0c2760 con 0x7f406c0c63a0 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071151700 1 -- 172.21.15.88:0/2016623039 >> v1:172.21.15.94:6789/0 conn(0x7f406c0c63a0 legacy=0x7f406c0c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359505405 0 0) 0x7f40580035d0 con 0x7f406c0c7d20 2024-09-13T18:09:19.616 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071151700 1 -- 172.21.15.88:0/2016623039 >> v1:172.21.15.88:6789/0 conn(0x7f406c0c7d20 legacy=0x7f406c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071151700 1 -- 172.21.15.88:0/2016623039 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0c2f70 con 0x7f406c0c6780 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071151700 1 --2- 172.21.15.88:0/2016623039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c6780 0x7f406c14fec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4064009850 tx=0x7f4064009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41036077858ce45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c001670 con 0x7f406c0c6780 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4064004030 con 0x7f406c0c6780 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f406b7fe700 1 -- 172.21.15.88:0/2016623039 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40640043a0 con 0x7f406c0c6780 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- 172.21.15.88:0/2016623039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c6780 msgr2=0x7f406c14fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 --2- 172.21.15.88:0/2016623039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c6780 0x7f406c14fec0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4064009850 tx=0x7f4064009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:19.617 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- 172.21.15.88:0/2016623039 shutdown_connections 2024-09-13T18:09:19.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 --2- 172.21.15.88:0/2016623039 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c6780 0x7f406c14fec0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- 172.21.15.88:0/2016623039 >> 172.21.15.88:0/2016623039 conn(0x7f406c0c7120 msgr2=0x7f406c0c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- 172.21.15.88:0/2016623039 shutdown_connections 2024-09-13T18:09:19.618 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.607+0000 7f4071952700 1 -- 172.21.15.88:0/2016623039 wait complete. 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 Processor -- start 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- start start 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f406c0c63a0 0x7f406c1f2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c7d20 0x7f406c13e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c13f840 con 0x7f406c0c6780 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c163520 con 0x7f406c0c7d20 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c163d30 con 0x7f406c0c63a0 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53134/0 (socket says 172.21.15.88:53134) 2024-09-13T18:09:19.621 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 -- 172.21.15.88:0/1756348525 learned_addr learned my addr 172.21.15.88:0/1756348525 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071151700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c7d20 0x7f406c13e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4070950700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f406c0c63a0 0x7f406c1f2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 -- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f406c0c63a0 msgr2=0x7f406c1f2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f406c0c63a0 0x7f406c1f2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 -- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c7d20 msgr2=0x7f406c13e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c7d20 0x7f406c13e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 -- 172.21.15.88:0/1756348525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40640094b0 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f406bfff700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c750 tx=0x7f405c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c004ca0 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c004e00 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c1eed10 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0072f0 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.611+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c163a50 con 0x7f406c0c6780 2024-09-13T18:09:19.622 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c0c1b20 con 0x7f406c0c6780 2024-09-13T18:09:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f405c007450 con 0x7f406c0c6780 2024-09-13T18:09:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f40697fa700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 0x7f404c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f405c083f10 con 0x7f406c0c6780 2024-09-13T18:09:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f4070950700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 0x7f404c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.623 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.615+0000 7f4070950700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 0x7f404c068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f405400f290 tx=0x7f4054009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.629 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.623+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f405c051200 con 0x7f406c0c6780 2024-09-13T18:09:19.802 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.795+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f406c0c5d40 con 0x7f406c0c6780 2024-09-13T18:09:19.803 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f40697fa700 1 -- 172.21.15.88:0/1756348525 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f405c054820 con 0x7f406c0c6780 2024-09-13T18:09:19.803 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2024-09-13T18:09:19.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 msgr2=0x7f404c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 0x7f404c068bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f405400f290 tx=0x7f4054009040 comp rx=0 tx=0).stop 2024-09-13T18:09:19.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 msgr2=0x7f406c1ef1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c750 tx=0x7f405c00ca60 comp rx=0 tx=0).stop 2024-09-13T18:09:19.807 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 shutdown_connections 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f404c066730 0x7f404c068bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f406c0c7d20 0x7f406c13e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f406c0c6780 0x7f406c1ef1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 --2- 172.21.15.88:0/1756348525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f406c0c63a0 0x7f406c1f2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 >> 172.21.15.88:0/1756348525 conn(0x7f406c0c7120 msgr2=0x7f406c14f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.808 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 shutdown_connections 2024-09-13T18:09:19.809 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.799+0000 7f4071952700 1 -- 172.21.15.88:0/1756348525 wait complete. 2024-09-13T18:09:19.820 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:09:19.934 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.927+0000 7f6cfbc9b700 1 Processor -- start 2024-09-13T18:09:19.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.927+0000 7f6cfbc9b700 1 -- start start 2024-09-13T18:09:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6cf4157490 0x7f6cf40c5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf40c5d80 0x7f6cf40717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40c5520 con 0x7f6cf4071d10 2024-09-13T18:09:19.939 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf415d6a0 con 0x7f6cf40c5d80 2024-09-13T18:09:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf415d980 con 0x7f6cf4157490 2024-09-13T18:09:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf40c5d80 0x7f6cf40717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6cf40c5d80 0x7f6cf40717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53144/0 (socket says 172.21.15.88:53144) 2024-09-13T18:09:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 -- 172.21.15.88:0/371590644 learned_addr learned my addr 172.21.15.88:0/371590644 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:19.940 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9a37700 1 --2- 172.21.15.88:0/371590644 >> v2:172.21.15.94:3300/0 conn(0x7f6cf4157490 0x7f6cf40c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 -- 172.21.15.88:0/371590644 >> v2:172.21.15.94:3300/0 conn(0x7f6cf4157490 msgr2=0x7f6cf40c5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:19.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 --2- 172.21.15.88:0/371590644 >> v2:172.21.15.94:3300/0 conn(0x7f6cf4157490 0x7f6cf40c5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 -- 172.21.15.88:0/371590644 >> v1:172.21.15.94:6789/0 conn(0x7f6cf4071d10 legacy=0x7f6cf4160ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 -- 172.21.15.88:0/371590644 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf415dc60 con 0x7f6cf40c5d80 2024-09-13T18:09:19.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf9236700 1 --2- 172.21.15.88:0/371590644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf40717d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf406ff40 tx=0x7f6cf0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966f0fa0d11c4d64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf8a35700 1 -- 172.21.15.88:0/371590644 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000b8a0 con 0x7f6cf40c5d80 2024-09-13T18:09:19.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf8a35700 1 -- 172.21.15.88:0/371590644 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf000ba00 con 0x7f6cf40c5d80 2024-09-13T18:09:19.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cf8a35700 1 -- 172.21.15.88:0/371590644 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf000bd90 con 0x7f6cf40c5d80 2024-09-13T18:09:19.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/371590644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 msgr2=0x7f6cf40717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/371590644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf40717d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf406ff40 tx=0x7f6cf0009bf0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/371590644 shutdown_connections 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/371590644 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf40717d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/371590644 >> v2:172.21.15.94:3300/0 conn(0x7f6cf4157490 0x7f6cf40c5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/371590644 >> 172.21.15.88:0/371590644 conn(0x7f6cf40ca790 msgr2=0x7f6cf40caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/371590644 shutdown_connections 2024-09-13T18:09:19.943 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.931+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/371590644 wait complete. 2024-09-13T18:09:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 Processor -- start 2024-09-13T18:09:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- start start 2024-09-13T18:09:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cf4071d10 0x7f6cf415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.948 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6cf4157490 0x7f6cf415eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf414de60 con 0x7f6cf40c5d80 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf414dba0 con 0x7f6cf4071d10 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41603a0 con 0x7f6cf4157490 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53156/0 (socket says 172.21.15.88:53156) 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 -- 172.21.15.88:0/1660153571 learned_addr learned my addr 172.21.15.88:0/1660153571 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfa238700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6cf4157490 0x7f6cf415eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9a37700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cf4071d10 0x7f6cf415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 -- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6cf4157490 msgr2=0x7f6cf415eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.949 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6cf4157490 0x7f6cf415eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 -- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cf4071d10 msgr2=0x7f6cf415f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cf4071d10 0x7f6cf415f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 -- 172.21.15.88:0/1660153571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf0009570 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cf9236700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000b0e0 tx=0x7f6cf0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00036c0 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf001f070 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf414e120 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0003a80 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.935+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf415aab0 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf4067690 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6cf0021030 con 0x7f6cf40c5d80 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cea7fc700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 0x7f6cd8068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:19.950 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6cf00858c0 con 0x7f6cf40c5d80 2024-09-13T18:09:19.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cf9a37700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 0x7f6cd8068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:19.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.939+0000 7f6cf9a37700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 0x7f6cd8068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4154540 tx=0x7f6ce4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:19.951 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:19.947+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f6cf0052b10 con 0x7f6cf40c5d80 2024-09-13T18:09:20.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.131+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6cf406d770 con 0x7f6cf40c5d80 2024-09-13T18:09:20.136 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.131+0000 7f6cea7fc700 1 -- 172.21.15.88:0/1660153571 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6cf0056130 con 0x7f6cf40c5d80 2024-09-13T18:09:20.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.131+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 msgr2=0x7f6cd8068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:20.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.131+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 0x7f6cd8068c20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6cf4154540 tx=0x7f6ce4008040 comp rx=0 tx=0).stop 2024-09-13T18:09:20.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.131+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 msgr2=0x7f6cf415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf000b0e0 tx=0x7f6cf0004770 comp rx=0 tx=0).stop 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 shutdown_connections 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f6cd8066760 0x7f6cd8068c20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6cf4157490 0x7f6cf415eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6cf40c5d80 0x7f6cf415e5b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 --2- 172.21.15.88:0/1660153571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cf4071d10 0x7f6cf415f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 >> 172.21.15.88:0/1660153571 conn(0x7f6cf40ca790 msgr2=0x7f6cf40cab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 shutdown_connections 2024-09-13T18:09:20.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:20.135+0000 7f6cfbc9b700 1 -- 172.21.15.88:0/1660153571 wait complete. 2024-09-13T18:09:20.141 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2024-09-13T18:09:20.152 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2024-09-13T18:09:20.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:09:20.153 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-13T18:09:20.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:09:20.188 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi088.stderr:ceph-fuse[32606]: fuse finished with error 0 and tester_r 0 2024-09-13T18:09:26.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:09:26.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:09:26.290 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:09:26.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:09:26.316 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2024-09-13T18:09:26.328 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:09:26.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:09:26.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:09:26.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:09:26.388 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2024-09-13T18:09:26.545 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:09:26.555 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:09:26.556 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:09:26.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 Processor -- start 2024-09-13T18:09:26.673 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 -- start start 2024-09-13T18:09:26.675 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f04ac150b30 0x7f04ac06e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 0x7f04ac06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04ac06dce0 con 0x7f04ac0c3e30 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04ac06e010 con 0x7f04ac150b30 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04ab59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac06d140 con 0x7f04ac06f6a0 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04aad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f04ac0c3e30 0x7f04ac15a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36050/0 (socket says 172.21.15.88:36050) 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04aad9d700 1 -- 172.21.15.88:0/1021659004 learned_addr learned my addr 172.21.15.88:0/1021659004 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a9d9b700 1 --2- 172.21.15.88:0/1021659004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 0x7f04ac06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04aa59c700 1 --2- 172.21.15.88:0/1021659004 >> v2:172.21.15.94:3300/0 conn(0x7f04ac150b30 0x7f04ac06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a959a700 1 -- 172.21.15.88:0/1021659004 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246270661 0 0) 0x7f04ac06dce0 con 0x7f04ac0c3e30 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a959a700 1 -- 172.21.15.88:0/1021659004 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04940035d0 con 0x7f04ac0c3e30 2024-09-13T18:09:26.676 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a9d9b700 1 -- 172.21.15.88:0/1021659004 >> v2:172.21.15.94:3300/0 conn(0x7f04ac150b30 msgr2=0x7f04ac06e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a9d9b700 1 --2- 172.21.15.88:0/1021659004 >> v2:172.21.15.94:3300/0 conn(0x7f04ac150b30 0x7f04ac06e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a9d9b700 1 -- 172.21.15.88:0/1021659004 >> v1:172.21.15.88:6789/0 conn(0x7f04ac0c3e30 legacy=0x7f04ac15a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.667+0000 7f04a9d9b700 1 -- 172.21.15.88:0/1021659004 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04ac06bcb0 con 0x7f04ac06f6a0 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04a9d9b700 1 --2- 172.21.15.88:0/1021659004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 0x7f04ac06fae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f049c009d90 tx=0x7f049c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=780da238adf5d2de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04a959a700 1 -- 172.21.15.88:0/1021659004 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00e070 con 0x7f04ac06f6a0 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04a959a700 1 -- 172.21.15.88:0/1021659004 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049c00bb20 con 0x7f04ac06f6a0 2024-09-13T18:09:26.677 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04a959a700 1 -- 172.21.15.88:0/1021659004 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c012430 con 0x7f04ac06f6a0 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- 172.21.15.88:0/1021659004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 msgr2=0x7f04ac06fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 --2- 172.21.15.88:0/1021659004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 0x7f04ac06fae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f049c009d90 tx=0x7f049c00b330 comp rx=0 tx=0).stop 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- 172.21.15.88:0/1021659004 shutdown_connections 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 --2- 172.21.15.88:0/1021659004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac06f6a0 0x7f04ac06fae0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 --2- 172.21.15.88:0/1021659004 >> v2:172.21.15.94:3300/0 conn(0x7f04ac150b30 0x7f04ac06e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- 172.21.15.88:0/1021659004 >> 172.21.15.88:0/1021659004 conn(0x7f04ac0ca720 msgr2=0x7f04ac0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- 172.21.15.88:0/1021659004 shutdown_connections 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- 172.21.15.88:0/1021659004 wait complete. 2024-09-13T18:09:26.681 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 Processor -- start 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.671+0000 7f04ab59e700 1 -- start start 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04ac06f6a0 0x7f04ac158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac0c3e30 0x7f04ac159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac155330 con 0x7f04ac150b30 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac154ea0 con 0x7f04ac06f6a0 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac15a620 con 0x7f04ac0c3e30 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59632/0 (socket says 172.21.15.88:59632) 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 -- 172.21.15.88:0/2603553902 learned_addr learned my addr 172.21.15.88:0/2603553902 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04a9d9b700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac0c3e30 0x7f04ac159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.682 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aa59c700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04ac06f6a0 0x7f04ac158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 -- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac0c3e30 msgr2=0x7f04ac159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac0c3e30 0x7f04ac159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 -- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04ac06f6a0 msgr2=0x7f04ac158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04ac06f6a0 0x7f04ac158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 -- 172.21.15.88:0/2603553902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c009a70 con 0x7f04ac150b30 2024-09-13T18:09:26.683 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04aad9d700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c520 tx=0x7f04a400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4005d90 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a40070d0 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a4007460 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac15a340 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.675+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac154b30 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.679+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac155050 con 0x7f04ac150b30 2024-09-13T18:09:26.684 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.679+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f04a40075c0 con 0x7f04ac150b30 2024-09-13T18:09:26.685 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.679+0000 7f049affd700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 0x7f048c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:26.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.679+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f04a40835e0 con 0x7f04ac150b30 2024-09-13T18:09:26.686 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.679+0000 7f04aa59c700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 0x7f048c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:26.687 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.683+0000 7f04aa59c700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 0x7f048c068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009b50 tx=0x7f04a0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:26.694 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.687+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f04ac155050 con 0x7f04ac150b30 2024-09-13T18:09:26.864 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.859+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04ac06c530 con 0x7f048c066730 2024-09-13T18:09:26.881 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.875+0000 7f049affd700 1 -- 172.21.15.88:0/2603553902 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289019 (secure 0 0 0) 0x7f04a0011810 con 0x7f048c066730 2024-09-13T18:09:26.886 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 msgr2=0x7f048c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 0x7f048c068bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009b50 tx=0x7f04a0009240 comp rx=0 tx=0).stop 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 msgr2=0x7f04ac152560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04a400c520 tx=0x7f04a400c830 comp rx=0 tx=0).stop 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 shutdown_connections 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f048c066730 0x7f048c068bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f04ac0c3e30 0x7f04ac159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04ac150b30 0x7f04ac152560 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 --2- 172.21.15.88:0/2603553902 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f04ac06f6a0 0x7f04ac158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 >> 172.21.15.88:0/2603553902 conn(0x7f04ac0ca720 msgr2=0x7f04ac0c5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 shutdown_connections 2024-09-13T18:09:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:26.879+0000 7f04ab59e700 1 -- 172.21.15.88:0/2603553902 wait complete. 2024-09-13T18:09:26.890 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:09:26.901 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2024-09-13T18:09:25.041760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":810351,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9623,"num_write_kb":25168544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9810,"ondisk_log_size":9810,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":316896,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":314355,"kb_avail":754657824,"statfs":{"total":773094113280,"available":772769611776,"internally_reserved":0,"allocated":2523136,"data_stored":2271438,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":321900088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,14,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737404292,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2573,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004554"},"pg_stats":[{"pgid":"3.3f","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.670103+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:14.670103+0000","last_peered":"2024-09-13T18:09:14.670103+0000","last_clean":"2024-09-13T18:09:14.670103+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:14.670103+0000","last_undegraded":"2024-09-13T18:09:14.670103+0000","last_fullsized":"2024-09-13T18:09:14.670103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218109+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:09:20.218109+0000","last_peered":"2024-09-13T18:09:20.218109+0000","last_clean":"2024-09-13T18:09:20.218109+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:20.218109+0000","last_undegraded":"2024-09-13T18:09:20.218109+0000","last_fullsized":"2024-09-13T18:09:20.218109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.214676+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:09:20.214676+0000","last_peered":"2024-09-13T18:09:20.214676+0000","last_clean":"2024-09-13T18:09:20.214676+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:20.214676+0000","last_undegraded":"2024-09-13T18:09:20.214676+0000","last_fullsized":"2024-09-13T18:09:20.214676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245923+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:20.245923+0000","last_peered":"2024-09-13T18:09:20.245923+0000","last_clean":"2024-09-13T18:09:20.245923+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:20.245923+0000","last_undegraded":"2024-09-13T18:09:20.245923+0000","last_fullsized":"2024-09-13T18:09:20.245923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.691342+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:14.691342+0000","last_peered":"2024-09-13T18:09:14.691342+0000","last_clean":"2024-09-13T18:09:14.691342+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:14.691342+0000","last_undegraded":"2024-09-13T18:09:14.691342+0000","last_fullsized":"2024-09-13T18:09:14.691342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.242592+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.242592+0000","last_peered":"2024-09-13T18:09:20.242592+0000","last_clean":"2024-09-13T18:09:20.242592+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.242592+0000","last_undegraded":"2024-09-13T18:09:20.242592+0000","last_fullsized":"2024-09-13T18:09:20.242592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'159","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.670031+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:09:14.670031+0000","last_peered":"2024-09-13T18:09:14.670031+0000","last_clean":"2024-09-13T18:09:14.670031+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:09:14.670031+0000","last_undegraded":"2024-09-13T18:09:14.670031+0000","last_fullsized":"2024-09-13T18:09:14.670031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'177","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.707911+0000","last_change":"2024-09-13T18:06:16.752158+0000","last_active":"2024-09-13T18:09:14.707911+0000","last_peered":"2024-09-13T18:09:14.707911+0000","last_clean":"2024-09-13T18:09:14.707911+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:14.707911+0000","last_undegraded":"2024-09-13T18:09:14.707911+0000","last_fullsized":"2024-09-13T18:09:14.707911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:39.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.672963+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:09:14.672963+0000","last_peered":"2024-09-13T18:09:14.672963+0000","last_clean":"2024-09-13T18:09:14.672963+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:09:14.672963+0000","last_undegraded":"2024-09-13T18:09:14.672963+0000","last_fullsized":"2024-09-13T18:09:14.672963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'141","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.681534+0000","last_change":"2024-09-13T18:06:16.720806+0000","last_active":"2024-09-13T18:09:14.681534+0000","last_peered":"2024-09-13T18:09:14.681534+0000","last_clean":"2024-09-13T18:09:14.681534+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:14.681534+0000","last_undegraded":"2024-09-13T18:09:14.681534+0000","last_fullsized":"2024-09-13T18:09:14.681534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:00.555081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.663092+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:09:14.663092+0000","last_peered":"2024-09-13T18:09:14.663092+0000","last_clean":"2024-09-13T18:09:14.663092+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:14.663092+0000","last_undegraded":"2024-09-13T18:09:14.663092+0000","last_fullsized":"2024-09-13T18:09:14.663092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.676521+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:09:14.676521+0000","last_peered":"2024-09-13T18:09:14.676521+0000","last_clean":"2024-09-13T18:09:14.676521+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:14.676521+0000","last_undegraded":"2024-09-13T18:09:14.676521+0000","last_fullsized":"2024-09-13T18:09:14.676521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.662720+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:09:14.662720+0000","last_peered":"2024-09-13T18:09:14.662720+0000","last_clean":"2024-09-13T18:09:14.662720+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:09:14.662720+0000","last_undegraded":"2024-09-13T18:09:14.662720+0000","last_fullsized":"2024-09-13T18:09:14.662720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222864+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:09:20.222864+0000","last_peered":"2024-09-13T18:09:20.222864+0000","last_clean":"2024-09-13T18:09:20.222864+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:20.222864+0000","last_undegraded":"2024-09-13T18:09:20.222864+0000","last_fullsized":"2024-09-13T18:09:20.222864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.225712+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:09:20.225712+0000","last_peered":"2024-09-13T18:09:20.225712+0000","last_clean":"2024-09-13T18:09:20.225712+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:20.225712+0000","last_undegraded":"2024-09-13T18:09:20.225712+0000","last_fullsized":"2024-09-13T18:09:20.225712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239166+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:09:20.239166+0000","last_peered":"2024-09-13T18:09:20.239166+0000","last_clean":"2024-09-13T18:09:20.239166+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:20.239166+0000","last_undegraded":"2024-09-13T18:09:20.239166+0000","last_fullsized":"2024-09-13T18:09:20.239166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246407+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:09:20.246407+0000","last_peered":"2024-09-13T18:09:20.246407+0000","last_clean":"2024-09-13T18:09:20.246407+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:20.246407+0000","last_undegraded":"2024-09-13T18:09:20.246407+0000","last_fullsized":"2024-09-13T18:09:20.246407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235075+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:09:20.235075+0000","last_peered":"2024-09-13T18:09:20.235075+0000","last_clean":"2024-09-13T18:09:20.235075+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:20.235075+0000","last_undegraded":"2024-09-13T18:09:20.235075+0000","last_fullsized":"2024-09-13T18:09:20.235075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'165","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.700629+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:14.700629+0000","last_peered":"2024-09-13T18:09:14.700629+0000","last_clean":"2024-09-13T18:09:14.700629+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:14.700629+0000","last_undegraded":"2024-09-13T18:09:14.700629+0000","last_fullsized":"2024-09-13T18:09:14.700629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'153","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.686350+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:09:14.686350+0000","last_peered":"2024-09-13T18:09:14.686350+0000","last_clean":"2024-09-13T18:09:14.686350+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:14.686350+0000","last_undegraded":"2024-09-13T18:09:14.686350+0000","last_fullsized":"2024-09-13T18:09:14.686350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229849+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:09:20.229849+0000","last_peered":"2024-09-13T18:09:20.229849+0000","last_clean":"2024-09-13T18:09:20.229849+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:20.229849+0000","last_undegraded":"2024-09-13T18:09:20.229849+0000","last_fullsized":"2024-09-13T18:09:20.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245252+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:09:20.245252+0000","last_peered":"2024-09-13T18:09:20.245252+0000","last_clean":"2024-09-13T18:09:20.245252+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:09:20.245252+0000","last_undegraded":"2024-09-13T18:09:20.245252+0000","last_fullsized":"2024-09-13T18:09:20.245252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'126","reported_seq":139,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.557062+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:09:14.557062+0000","last_peered":"2024-09-13T18:09:14.557062+0000","last_clean":"2024-09-13T18:09:14.557062+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:14.557062+0000","last_undegraded":"2024-09-13T18:09:14.557062+0000","last_fullsized":"2024-09-13T18:09:14.557062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":126,"log_dups_size":0,"ondisk_log_size":126,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239102+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:09:20.239102+0000","last_peered":"2024-09-13T18:09:20.239102+0000","last_clean":"2024-09-13T18:09:20.239102+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:20.239102+0000","last_undegraded":"2024-09-13T18:09:20.239102+0000","last_fullsized":"2024-09-13T18:09:20.239102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'132","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.685221+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:09:14.685221+0000","last_peered":"2024-09-13T18:09:14.685221+0000","last_clean":"2024-09-13T18:09:14.685221+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:14.685221+0000","last_undegraded":"2024-09-13T18:09:14.685221+0000","last_fullsized":"2024-09-13T18:09:14.685221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.690481+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:09:14.690481+0000","last_peered":"2024-09-13T18:09:14.690481+0000","last_clean":"2024-09-13T18:09:14.690481+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:14.690481+0000","last_undegraded":"2024-09-13T18:09:14.690481+0000","last_fullsized":"2024-09-13T18:09:14.690481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231150+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:09:20.231150+0000","last_peered":"2024-09-13T18:09:20.231150+0000","last_clean":"2024-09-13T18:09:20.231150+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:20.231150+0000","last_undegraded":"2024-09-13T18:09:20.231150+0000","last_fullsized":"2024-09-13T18:09:20.231150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'129","reported_seq":142,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.690014+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:09:14.690014+0000","last_peered":"2024-09-13T18:09:14.690014+0000","last_clean":"2024-09-13T18:09:14.690014+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:14.690014+0000","last_undegraded":"2024-09-13T18:09:14.690014+0000","last_fullsized":"2024-09-13T18:09:14.690014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235269+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:09:20.235269+0000","last_peered":"2024-09-13T18:09:20.235269+0000","last_clean":"2024-09-13T18:09:20.235269+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:20.235269+0000","last_undegraded":"2024-09-13T18:09:20.235269+0000","last_fullsized":"2024-09-13T18:09:20.235269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231767+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:09:20.231767+0000","last_peered":"2024-09-13T18:09:20.231767+0000","last_clean":"2024-09-13T18:09:20.231767+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:20.231767+0000","last_undegraded":"2024-09-13T18:09:20.231767+0000","last_fullsized":"2024-09-13T18:09:20.231767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239797+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:09:20.239797+0000","last_peered":"2024-09-13T18:09:20.239797+0000","last_clean":"2024-09-13T18:09:20.239797+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:20.239797+0000","last_undegraded":"2024-09-13T18:09:20.239797+0000","last_fullsized":"2024-09-13T18:09:20.239797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.655261+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:09:14.655261+0000","last_peered":"2024-09-13T18:09:14.655261+0000","last_clean":"2024-09-13T18:09:14.655261+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:14.655261+0000","last_undegraded":"2024-09-13T18:09:14.655261+0000","last_fullsized":"2024-09-13T18:09:14.655261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'123","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.613241+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:09:14.613241+0000","last_peered":"2024-09-13T18:09:14.613241+0000","last_clean":"2024-09-13T18:09:14.613241+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:14.613241+0000","last_undegraded":"2024-09-13T18:09:14.613241+0000","last_fullsized":"2024-09-13T18:09:14.613241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714141+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:06:16.714141+0000","last_peered":"2024-09-13T18:06:16.714141+0000","last_clean":"2024-09-13T18:06:16.714141+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:06:16.714141+0000","last_undegraded":"2024-09-13T18:06:16.714141+0000","last_fullsized":"2024-09-13T18:06:16.714141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1016,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229461+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:09:20.229461+0000","last_peered":"2024-09-13T18:09:20.229461+0000","last_clean":"2024-09-13T18:09:20.229461+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:20.229461+0000","last_undegraded":"2024-09-13T18:09:20.229461+0000","last_fullsized":"2024-09-13T18:09:20.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.716994+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:06:16.716994+0000","last_peered":"2024-09-13T18:06:16.716994+0000","last_clean":"2024-09-13T18:06:16.716994+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:06:16.716994+0000","last_undegraded":"2024-09-13T18:06:16.716994+0000","last_fullsized":"2024-09-13T18:06:16.716994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.713078+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:06:16.713078+0000","last_peered":"2024-09-13T18:06:16.713078+0000","last_clean":"2024-09-13T18:06:16.713078+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:06:16.713078+0000","last_undegraded":"2024-09-13T18:06:16.713078+0000","last_fullsized":"2024-09-13T18:06:16.713078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'162","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.664811+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:09:14.664811+0000","last_peered":"2024-09-13T18:09:14.664811+0000","last_clean":"2024-09-13T18:09:14.664811+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:14.664811+0000","last_undegraded":"2024-09-13T18:09:14.664811+0000","last_fullsized":"2024-09-13T18:09:14.664811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":162,"log_dups_size":0,"ondisk_log_size":162,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222469+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:06:17.222469+0000","last_peered":"2024-09-13T18:06:17.222469+0000","last_clean":"2024-09-13T18:06:17.222469+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:06:17.222469+0000","last_undegraded":"2024-09-13T18:06:17.222469+0000","last_fullsized":"2024-09-13T18:06:17.222469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231469+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:09:20.231469+0000","last_peered":"2024-09-13T18:09:20.231469+0000","last_clean":"2024-09-13T18:09:20.231469+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:20.231469+0000","last_undegraded":"2024-09-13T18:09:20.231469+0000","last_fullsized":"2024-09-13T18:09:20.231469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:53.632379+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:07:53.632379+0000","last_peered":"2024-09-13T18:07:53.632379+0000","last_clean":"2024-09-13T18:07:53.632379+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:07:53.632379+0000","last_undegraded":"2024-09-13T18:07:53.632379+0000","last_fullsized":"2024-09-13T18:07:53.632379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246708+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:09:20.246708+0000","last_peered":"2024-09-13T18:09:20.246708+0000","last_clean":"2024-09-13T18:09:20.246708+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:20.246708+0000","last_undegraded":"2024-09-13T18:09:20.246708+0000","last_fullsized":"2024-09-13T18:09:20.246708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223568+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:06:17.223568+0000","last_peered":"2024-09-13T18:06:17.223568+0000","last_clean":"2024-09-13T18:06:17.223568+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:06:17.223568+0000","last_undegraded":"2024-09-13T18:06:17.223568+0000","last_fullsized":"2024-09-13T18:06:17.223568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241669+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:09:20.241669+0000","last_peered":"2024-09-13T18:09:20.241669+0000","last_clean":"2024-09-13T18:09:20.241669+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:20.241669+0000","last_undegraded":"2024-09-13T18:09:20.241669+0000","last_fullsized":"2024-09-13T18:09:20.241669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.720977+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:09:14.720977+0000","last_peered":"2024-09-13T18:09:14.720977+0000","last_clean":"2024-09-13T18:09:14.720977+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:14.720977+0000","last_undegraded":"2024-09-13T18:09:14.720977+0000","last_fullsized":"2024-09-13T18:09:14.720977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.666236+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:09:14.666236+0000","last_peered":"2024-09-13T18:09:14.666236+0000","last_clean":"2024-09-13T18:09:14.666236+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:14.666236+0000","last_undegraded":"2024-09-13T18:09:14.666236+0000","last_fullsized":"2024-09-13T18:09:14.666236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'92","reported_seq":106,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:12.854640+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:09:12.854640+0000","last_peered":"2024-09-13T18:09:12.854640+0000","last_clean":"2024-09-13T18:09:12.854640+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:12.854640+0000","last_undegraded":"2024-09-13T18:09:12.854640+0000","last_fullsized":"2024-09-13T18:09:12.854640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":215522,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":92,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.633112+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:09:14.633112+0000","last_peered":"2024-09-13T18:09:14.633112+0000","last_clean":"2024-09-13T18:09:14.633112+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:09:14.633112+0000","last_undegraded":"2024-09-13T18:09:14.633112+0000","last_fullsized":"2024-09-13T18:09:14.633112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223524+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:06:17.223524+0000","last_peered":"2024-09-13T18:06:17.223524+0000","last_clean":"2024-09-13T18:06:17.223524+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:06:17.223524+0000","last_undegraded":"2024-09-13T18:06:17.223524+0000","last_fullsized":"2024-09-13T18:06:17.223524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.226414+0000","last_change":"2024-09-13T18:06:17.149866+0000","last_active":"2024-09-13T18:09:20.226414+0000","last_peered":"2024-09-13T18:09:20.226414+0000","last_clean":"2024-09-13T18:09:20.226414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:20.226414+0000","last_undegraded":"2024-09-13T18:09:20.226414+0000","last_fullsized":"2024-09-13T18:09:20.226414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:10.096089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223854+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:06:17.223854+0000","last_peered":"2024-09-13T18:06:17.223854+0000","last_clean":"2024-09-13T18:06:17.223854+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:06:17.223854+0000","last_undegraded":"2024-09-13T18:06:17.223854+0000","last_fullsized":"2024-09-13T18:06:17.223854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'156","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.670064+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:09:14.670064+0000","last_peered":"2024-09-13T18:09:14.670064+0000","last_clean":"2024-09-13T18:09:14.670064+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:14.670064+0000","last_undegraded":"2024-09-13T18:09:14.670064+0000","last_fullsized":"2024-09-13T18:09:14.670064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.717003+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:06:16.717003+0000","last_peered":"2024-09-13T18:06:16.717003+0000","last_clean":"2024-09-13T18:06:16.717003+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:06:16.717003+0000","last_undegraded":"2024-09-13T18:06:16.717003+0000","last_fullsized":"2024-09-13T18:06:16.717003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'159","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.684569+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:09:14.684569+0000","last_peered":"2024-09-13T18:09:14.684569+0000","last_clean":"2024-09-13T18:09:14.684569+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:14.684569+0000","last_undegraded":"2024-09-13T18:09:14.684569+0000","last_fullsized":"2024-09-13T18:09:14.684569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:46.050658+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:07:46.050658+0000","last_peered":"2024-09-13T18:07:46.050658+0000","last_clean":"2024-09-13T18:07:46.050658+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:07:46.050658+0000","last_undegraded":"2024-09-13T18:07:46.050658+0000","last_fullsized":"2024-09-13T18:07:46.050658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.672276+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:09:14.672276+0000","last_peered":"2024-09-13T18:09:14.672276+0000","last_clean":"2024-09-13T18:09:14.672276+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:14.672276+0000","last_undegraded":"2024-09-13T18:09:14.672276+0000","last_fullsized":"2024-09-13T18:09:14.672276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.225545+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:06:17.225545+0000","last_peered":"2024-09-13T18:06:17.225545+0000","last_clean":"2024-09-13T18:06:17.225545+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:06:17.225545+0000","last_undegraded":"2024-09-13T18:06:17.225545+0000","last_fullsized":"2024-09-13T18:06:17.225545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.674330+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:09:14.674330+0000","last_peered":"2024-09-13T18:09:14.674330+0000","last_clean":"2024-09-13T18:09:14.674330+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:14.674330+0000","last_undegraded":"2024-09-13T18:09:14.674330+0000","last_fullsized":"2024-09-13T18:09:14.674330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714515+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:06:16.714515+0000","last_peered":"2024-09-13T18:06:16.714515+0000","last_clean":"2024-09-13T18:06:16.714515+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:06:16.714515+0000","last_undegraded":"2024-09-13T18:06:16.714515+0000","last_fullsized":"2024-09-13T18:06:16.714515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'129","reported_seq":142,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.659444+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:09:14.659444+0000","last_peered":"2024-09-13T18:09:14.659444+0000","last_clean":"2024-09-13T18:09:14.659444+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:14.659444+0000","last_undegraded":"2024-09-13T18:09:14.659444+0000","last_fullsized":"2024-09-13T18:09:14.659444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":129,"log_dups_size":0,"ondisk_log_size":129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.750024+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:06:16.750024+0000","last_peered":"2024-09-13T18:06:16.750024+0000","last_clean":"2024-09-13T18:06:16.750024+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:06:16.750024+0000","last_undegraded":"2024-09-13T18:06:16.750024+0000","last_fullsized":"2024-09-13T18:06:16.750024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222327+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:20.222327+0000","last_peered":"2024-09-13T18:09:20.222327+0000","last_clean":"2024-09-13T18:09:20.222327+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:20.222327+0000","last_undegraded":"2024-09-13T18:09:20.222327+0000","last_fullsized":"2024-09-13T18:09:20.222327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714215+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:06:16.714215+0000","last_peered":"2024-09-13T18:06:16.714215+0000","last_clean":"2024-09-13T18:06:16.714215+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:06:16.714215+0000","last_undegraded":"2024-09-13T18:06:16.714215+0000","last_fullsized":"2024-09-13T18:06:16.714215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.629905+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:09:14.629905+0000","last_peered":"2024-09-13T18:09:14.629905+0000","last_clean":"2024-09-13T18:09:14.629905+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:14.629905+0000","last_undegraded":"2024-09-13T18:09:14.629905+0000","last_fullsized":"2024-09-13T18:09:14.629905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:20.054603+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:07:20.054603+0000","last_peered":"2024-09-13T18:07:20.054603+0000","last_clean":"2024-09-13T18:07:20.054603+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:07:20.054603+0000","last_undegraded":"2024-09-13T18:07:20.054603+0000","last_fullsized":"2024-09-13T18:07:20.054603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222824+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:06:17.222824+0000","last_peered":"2024-09-13T18:06:17.222824+0000","last_clean":"2024-09-13T18:06:17.222824+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:06:17.222824+0000","last_undegraded":"2024-09-13T18:06:17.222824+0000","last_fullsized":"2024-09-13T18:06:17.222824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239918+0000","last_change":"2024-09-13T18:06:17.227202+0000","last_active":"2024-09-13T18:09:20.239918+0000","last_peered":"2024-09-13T18:09:20.239918+0000","last_clean":"2024-09-13T18:09:20.239918+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:20.239918+0000","last_undegraded":"2024-09-13T18:09:20.239918+0000","last_fullsized":"2024-09-13T18:09:20.239918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:12.726841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146386+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:06:17.146386+0000","last_peered":"2024-09-13T18:06:17.146386+0000","last_clean":"2024-09-13T18:06:17.146386+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:06:17.146386+0000","last_undegraded":"2024-09-13T18:06:17.146386+0000","last_fullsized":"2024-09-13T18:06:17.146386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229227+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:09:20.229227+0000","last_peered":"2024-09-13T18:09:20.229227+0000","last_clean":"2024-09-13T18:09:20.229227+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:20.229227+0000","last_undegraded":"2024-09-13T18:09:20.229227+0000","last_fullsized":"2024-09-13T18:09:20.229227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.707089+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:09:18.707089+0000","last_peered":"2024-09-13T18:09:18.707089+0000","last_clean":"2024-09-13T18:09:18.707089+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:18.707089+0000","last_undegraded":"2024-09-13T18:09:18.707089+0000","last_fullsized":"2024-09-13T18:09:18.707089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218962+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:09:20.218962+0000","last_peered":"2024-09-13T18:09:20.218962+0000","last_clean":"2024-09-13T18:09:20.218962+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:20.218962+0000","last_undegraded":"2024-09-13T18:09:20.218962+0000","last_fullsized":"2024-09-13T18:09:20.218962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223846+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:06:17.223846+0000","last_peered":"2024-09-13T18:06:17.223846+0000","last_clean":"2024-09-13T18:06:17.223846+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:06:17.223846+0000","last_undegraded":"2024-09-13T18:06:17.223846+0000","last_fullsized":"2024-09-13T18:06:17.223846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.667903+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:09:14.667903+0000","last_peered":"2024-09-13T18:09:14.667903+0000","last_clean":"2024-09-13T18:09:14.667903+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:14.667903+0000","last_undegraded":"2024-09-13T18:09:14.667903+0000","last_fullsized":"2024-09-13T18:09:14.667903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749841+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:06:16.749841+0000","last_peered":"2024-09-13T18:06:16.749841+0000","last_clean":"2024-09-13T18:06:16.749841+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:06:16.749841+0000","last_undegraded":"2024-09-13T18:06:16.749841+0000","last_fullsized":"2024-09-13T18:06:16.749841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240024+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:09:20.240024+0000","last_peered":"2024-09-13T18:09:20.240024+0000","last_clean":"2024-09-13T18:09:20.240024+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:20.240024+0000","last_undegraded":"2024-09-13T18:09:20.240024+0000","last_fullsized":"2024-09-13T18:09:20.240024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.147552+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:06:17.147552+0000","last_peered":"2024-09-13T18:06:17.147552+0000","last_clean":"2024-09-13T18:06:17.147552+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:06:17.147552+0000","last_undegraded":"2024-09-13T18:06:17.147552+0000","last_fullsized":"2024-09-13T18:06:17.147552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.219097+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:09:20.219097+0000","last_peered":"2024-09-13T18:09:20.219097+0000","last_clean":"2024-09-13T18:09:20.219097+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:20.219097+0000","last_undegraded":"2024-09-13T18:09:20.219097+0000","last_fullsized":"2024-09-13T18:09:20.219097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'17","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:06.510247+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:09:06.510247+0000","last_peered":"2024-09-13T18:09:06.510247+0000","last_clean":"2024-09-13T18:09:06.510247+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:06.510247+0000","last_undegraded":"2024-09-13T18:09:06.510247+0000","last_fullsized":"2024-09-13T18:09:06.510247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.696619+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:09:14.696619+0000","last_peered":"2024-09-13T18:09:14.696619+0000","last_clean":"2024-09-13T18:09:14.696619+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:14.696619+0000","last_undegraded":"2024-09-13T18:09:14.696619+0000","last_fullsized":"2024-09-13T18:09:14.696619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:40.049606+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:07:40.049606+0000","last_peered":"2024-09-13T18:07:40.049606+0000","last_clean":"2024-09-13T18:07:40.049606+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:07:40.049606+0000","last_undegraded":"2024-09-13T18:07:40.049606+0000","last_fullsized":"2024-09-13T18:07:40.049606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221838+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:09:20.221838+0000","last_peered":"2024-09-13T18:09:20.221838+0000","last_clean":"2024-09-13T18:09:20.221838+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:20.221838+0000","last_undegraded":"2024-09-13T18:09:20.221838+0000","last_fullsized":"2024-09-13T18:09:20.221838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146357+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:06:17.146357+0000","last_peered":"2024-09-13T18:06:17.146357+0000","last_clean":"2024-09-13T18:06:17.146357+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:06:17.146357+0000","last_undegraded":"2024-09-13T18:06:17.146357+0000","last_fullsized":"2024-09-13T18:06:17.146357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'132","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.550140+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:09:14.550140+0000","last_peered":"2024-09-13T18:09:14.550140+0000","last_clean":"2024-09-13T18:09:14.550140+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:14.550140+0000","last_undegraded":"2024-09-13T18:09:14.550140+0000","last_fullsized":"2024-09-13T18:09:14.550140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749639+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:06:16.749639+0000","last_peered":"2024-09-13T18:06:16.749639+0000","last_clean":"2024-09-13T18:06:16.749639+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:06:16.749639+0000","last_undegraded":"2024-09-13T18:06:16.749639+0000","last_fullsized":"2024-09-13T18:06:16.749639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.694070+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:09:14.694070+0000","last_peered":"2024-09-13T18:09:14.694070+0000","last_clean":"2024-09-13T18:09:14.694070+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:14.694070+0000","last_undegraded":"2024-09-13T18:09:14.694070+0000","last_fullsized":"2024-09-13T18:09:14.694070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749649+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:06:16.749649+0000","last_peered":"2024-09-13T18:06:16.749649+0000","last_clean":"2024-09-13T18:06:16.749649+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:06:16.749649+0000","last_undegraded":"2024-09-13T18:06:16.749649+0000","last_fullsized":"2024-09-13T18:06:16.749649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.657191+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:09:14.657191+0000","last_peered":"2024-09-13T18:09:14.657191+0000","last_clean":"2024-09-13T18:09:14.657191+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:14.657191+0000","last_undegraded":"2024-09-13T18:09:14.657191+0000","last_fullsized":"2024-09-13T18:09:14.657191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:45.060694+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:07:45.060694+0000","last_peered":"2024-09-13T18:07:45.060694+0000","last_clean":"2024-09-13T18:07:45.060694+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:07:45.060694+0000","last_undegraded":"2024-09-13T18:07:45.060694+0000","last_fullsized":"2024-09-13T18:07:45.060694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'123","reported_seq":136,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.640141+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:09:14.640141+0000","last_peered":"2024-09-13T18:09:14.640141+0000","last_clean":"2024-09-13T18:09:14.640141+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:14.640141+0000","last_undegraded":"2024-09-13T18:09:14.640141+0000","last_fullsized":"2024-09-13T18:09:14.640141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245337+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:09:20.245337+0000","last_peered":"2024-09-13T18:09:20.245337+0000","last_clean":"2024-09-13T18:09:20.245337+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:09:20.245337+0000","last_undegraded":"2024-09-13T18:09:20.245337+0000","last_fullsized":"2024-09-13T18:09:20.245337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146813+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:06:17.146813+0000","last_peered":"2024-09-13T18:06:17.146813+0000","last_clean":"2024-09-13T18:06:17.146813+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:06:17.146813+0000","last_undegraded":"2024-09-13T18:06:17.146813+0000","last_fullsized":"2024-09-13T18:06:17.146813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245976+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.245976+0000","last_peered":"2024-09-13T18:09:20.245976+0000","last_clean":"2024-09-13T18:09:20.245976+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.245976+0000","last_undegraded":"2024-09-13T18:09:20.245976+0000","last_fullsized":"2024-09-13T18:09:20.245976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:53.633949+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:07:53.633949+0000","last_peered":"2024-09-13T18:07:53.633949+0000","last_clean":"2024-09-13T18:07:53.633949+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:07:53.633949+0000","last_undegraded":"2024-09-13T18:07:53.633949+0000","last_fullsized":"2024-09-13T18:07:53.633949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241744+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:09:20.241744+0000","last_peered":"2024-09-13T18:09:20.241744+0000","last_clean":"2024-09-13T18:09:20.241744+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:20.241744+0000","last_undegraded":"2024-09-13T18:09:20.241744+0000","last_fullsized":"2024-09-13T18:09:20.241744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714885+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:06:16.714885+0000","last_peered":"2024-09-13T18:06:16.714885+0000","last_clean":"2024-09-13T18:06:16.714885+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:06:16.714885+0000","last_undegraded":"2024-09-13T18:06:16.714885+0000","last_fullsized":"2024-09-13T18:06:16.714885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'147","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.687403+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:09:14.687403+0000","last_peered":"2024-09-13T18:09:14.687403+0000","last_clean":"2024-09-13T18:09:14.687403+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:14.687403+0000","last_undegraded":"2024-09-13T18:09:14.687403+0000","last_fullsized":"2024-09-13T18:09:14.687403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223509+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:06:17.223509+0000","last_peered":"2024-09-13T18:06:17.223509+0000","last_clean":"2024-09-13T18:06:17.223509+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:06:17.223509+0000","last_undegraded":"2024-09-13T18:06:17.223509+0000","last_fullsized":"2024-09-13T18:06:17.223509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9468,"ondisk_log_size":9468,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":219983,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":248,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":439966,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509492,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,14,2],"upper_bound":128},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.624,"15min":0.66400000000000003},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.488,"15min":1.488},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.622,"15min":0.65100000000000002},"min":{"1min":0.28100000000000003,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.84299999999999997,"5min":1.097,"15min":1.097},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.432,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.77900000000000003,"15min":0.78200000000000003},"min":{"1min":0.371,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.48199999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65500000000000003,"15min":0.67300000000000004},"min":{"1min":0.40300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.753,"15min":0.79400000000000004},"min":{"1min":0.34399999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0629999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.85499999999999998,"15min":0.88300000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.2350000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89200000000000002,"15min":0.91100000000000003},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.4750000000000001,"5min":1.516,"15min":1.516},"last":0.44600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.97299999999999998,"15min":1.0169999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.4330000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":3.7919999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":1.014},"min":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.274,"5min":1.5489999999999999,"15min":1.5489999999999999},"last":3.4049999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.94999999999999996,"15min":0.996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.4359999999999999,"5min":1.907,"15min":1.907},"last":0.499},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.046,"15min":1.0980000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.4319999999999999,"5min":1.962,"15min":1.962},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":1.0329999999999999,"15min":1.089},"min":{"1min":0.61499999999999999,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.1830000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0029999999999999,"15min":1.0429999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4319999999999999,"5min":1.625,"15min":1.625},"last":2.278}]}]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60799999999999998,"15min":0.63600000000000001},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.622,"15min":0.66900000000000004},"min":{"1min":0.313,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.84599999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.877}]},{"osd":2,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.35199999999999998,"5min":0.25,"15min":0.25},"max":{"1min":2.077,"5min":2.077,"15min":2.077},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71399999999999997,"15min":0.74199999999999999},"min":{"1min":0.33800000000000002,"5min":0.246,"15min":0.246},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77200000000000002,"15min":0.81200000000000006},"min":{"1min":0.42599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.70999999999999996,"15min":0.748},"min":{"1min":0.40799999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.93899999999999995,"15min":0.94399999999999995},"min":{"1min":0.55000000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.96399999999999997,"15min":0.999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.254,"5min":1.347,"15min":1.347},"last":1.0529999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.96199999999999997,"15min":0.995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.95899999999999996,"15min":0.99299999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3109999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.052,"15min":1.1100000000000001},"min":{"1min":0.66700000000000004,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.3700000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.101},{"interface":"front","average":{"1min":0.91900000000000004,"5min":1.0029999999999999,"15min":1.0469999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.3759999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":1.0449999999999999,"15min":1.099},"min":{"1min":0.59999999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.3340000000000001,"5min":1.46,"15min":1.46},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.028,"5min":1.046,"15min":1.0820000000000001},"min":{"1min":0.626,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.4239999999999999,"5min":1.554,"15min":1.554},"last":1.071}]}]},{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43704,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328136,"statfs":{"total":96636764160,"available":96592011264,"internally_reserved":0,"allocated":311296,"data_stored":673420,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":44431819},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.232},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96099999999999997,"15min":1.054},"min":{"1min":0.50800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.159,"5min":6.093,"15min":6.093},"last":0.879}]},{"osd":1,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.079,"15min":1.169},"min":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2849999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.86299999999999999,"15min":0.90500000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.92000000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0649999999999999,"15min":1.165},"min":{"1min":0.59399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.377,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3200000000000001,"5min":1.363,"15min":1.363},"last":1.0369999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97199999999999998,"15min":0.98599999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.177,"15min":1.278},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.45,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.169,"15min":1.2569999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.772,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.204,"15min":1.294},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.411,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":1.113}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.347,"15min":1.4630000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0059999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.286},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.145,"15min":1.2190000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.274,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.069}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":297494,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:23 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.495,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":1},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.79700000000000004,"15min":0.78300000000000003},"min":{"1min":0.56599999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.79300000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.198,"5min":1.222,"15min":1.222},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.073}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.84999999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:08:23 2024","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.88500000000000001,"15min":0.89700000000000002},"min":{"1min":0.63400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.1319999999999999,"5min":1.169,"15min":1.169},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.3650000000000002,"5min":2.3650000000000002,"15min":2.3650000000000002},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 18:08:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.93400000000000005,"15min":0.96199999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1140000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.0529999999999999,"15min":1.038},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.0579999999999998,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":1.1830000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:08:23 2024","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.0229999999999999,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.113},{"interface":"front","average":{"1min":1.034,"5min":1.0609999999999999,"15min":1.0649999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":1.1299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:23 2024","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.0820000000000001,"15min":1.0629999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.115,"15min":1.1319999999999999},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.516,"5min":1.621,"15min":1.621},"last":1.0329999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542195,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86099999999999999,"15min":0.89200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.90700000000000003},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93400000000000005,"15min":0.96199999999999997},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0880000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97999999999999998,"15min":1.024},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.6799999999999999,"5min":1.909,"15min":1.909},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.113,"5min":1.089,"15min":1.1180000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":1.0529999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5169999999999999,"5min":1.885,"15min":1.885},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.123,"15min":1.1619999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5600000000000001,"5min":1.647,"15min":1.647},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.123,"15min":1.181},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3220000000000001,"5min":1.851,"15min":1.851},"last":1.2589999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":298475,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.27600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57999999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.751},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.75700000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.99299999999999999,"5min":1.798,"15min":1.798},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.88600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":1.0089999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":0.97199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0669999999999999,"5min":1.905,"15min":1.905},"last":1.097},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.95499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0609999999999999,"15min":1.0880000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0609999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.974,"15min":1.974},"last":1.1639999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.008,"15min":1.04},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3799999999999999,"5min":1.444,"15min":1.444},"last":1},{"interface":"front","average":{"1min":1.095,"5min":1.083,"15min":1.095},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":0.82299999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.077}]},{"osd":1,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.875},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.90400000000000003,"15min":0.95399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.121,"5min":1.173,"15min":1.173},"last":1.167}]},{"osd":2,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0720000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":1.097},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57899999999999996},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88,"5min":1.214,"15min":1.214},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.64400000000000002},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.76800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.054,"5min":2.27,"15min":2.27},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.542,"5min":2.306,"15min":2.306},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.012,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93200000000000005,"15min":0.96999999999999997},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1859999999999999,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8300000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0349999999999999,"15min":1.036},"min":{"1min":0.60399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0249999999999999,"15min":1.0649999999999999},"min":{"1min":0.57899999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.268,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0549999999999999,"15min":1.1020000000000001},"min":{"1min":0.63,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7270000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.081},{"interface":"front","average":{"1min":1.032,"5min":1.0680000000000001,"15min":1.1060000000000001},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.254,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.8759999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.133,"15min":1.1819999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.851,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":217133,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":216152,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:09:26.907 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:09:27.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 Processor -- start 2024-09-13T18:09:27.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- start start 2024-09-13T18:09:27.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f97000c63c0 0x7f970015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97000c5790 0x7f97001573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9700161b00 con 0x7f97000c5fe0 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9700072300 con 0x7f97000c5790 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970015dbc0 con 0x7f97000c63c0 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97000c5790 0x7f97001573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97000c5790 0x7f97001573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59640/0 (socket says 172.21.15.88:59640) 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 -- 172.21.15.88:0/3374028533 learned_addr learned my addr 172.21.15.88:0/3374028533 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:27.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f96f77fe700 1 --2- 172.21.15.88:0/3374028533 >> v2:172.21.15.94:3300/0 conn(0x7f97000c63c0 0x7f970015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 -- 172.21.15.88:0/3374028533 >> v2:172.21.15.94:3300/0 conn(0x7f97000c63c0 msgr2=0x7f970015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 --2- 172.21.15.88:0/3374028533 >> v2:172.21.15.94:3300/0 conn(0x7f97000c63c0 0x7f970015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 -- 172.21.15.88:0/3374028533 >> v1:172.21.15.94:6789/0 conn(0x7f97000c5fe0 legacy=0x7f97001613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 -- 172.21.15.88:0/3374028533 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970015dea0 con 0x7f97000c5790 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f9704a80700 1 --2- 172.21.15.88:0/3374028533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c5790 0x7f97001573d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f970006b830 tx=0x7f96f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f263e38b31a6d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f96ff7fe700 1 -- 172.21.15.88:0/3374028533 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800e070 con 0x7f97000c5790 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f96ff7fe700 1 -- 172.21.15.88:0/3374028533 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800b910 con 0x7f97000c5790 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f96ff7fe700 1 -- 172.21.15.88:0/3374028533 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800bcc0 con 0x7f97000c5790 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- 172.21.15.88:0/3374028533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c5790 msgr2=0x7f97001573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 --2- 172.21.15.88:0/3374028533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c5790 0x7f97001573d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f970006b830 tx=0x7f96f800b330 comp rx=0 tx=0).stop 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- 172.21.15.88:0/3374028533 shutdown_connections 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 --2- 172.21.15.88:0/3374028533 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c5790 0x7f97001573d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 --2- 172.21.15.88:0/3374028533 >> v2:172.21.15.94:3300/0 conn(0x7f97000c63c0 0x7f970015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- 172.21.15.88:0/3374028533 >> 172.21.15.88:0/3374028533 conn(0x7f97000ca790 msgr2=0x7f97000caba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- 172.21.15.88:0/3374028533 shutdown_connections 2024-09-13T18:09:27.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.055+0000 7f97064e3700 1 -- 172.21.15.88:0/3374028533 wait complete. 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 Processor -- start 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- start start 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97000c5790 0x7f97001f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97000c5fe0 0x7f97001f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9700158b00 con 0x7f97000c63c0 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970015cb90 con 0x7f97000c5fe0 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97001f2ae0 con 0x7f97000c5790 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59656/0 (socket says 172.21.15.88:59656) 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 -- 172.21.15.88:0/1466763863 learned_addr learned my addr 172.21.15.88:0/1466763863 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f96f77fe700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97000c5fe0 0x7f97001f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f96fffff700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97000c5790 0x7f97001f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 -- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97000c5790 msgr2=0x7f97001f6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97000c5790 0x7f97001f6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 -- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97000c5fe0 msgr2=0x7f97001f34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97000c5fe0 0x7f97001f34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 -- 172.21.15.88:0/1466763863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f8009b30 con 0x7f97000c63c0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f9704a80700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f97000cb850 tx=0x7f96f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8004930 con 0x7f97000c63c0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f80099b0 con 0x7f97000c63c0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97001f6fa0 con 0x7f97000c63c0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f801c680 con 0x7f97000c63c0 2024-09-13T18:09:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97001f3060 con 0x7f97000c63c0 2024-09-13T18:09:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.059+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97001f31f0 con 0x7f97000c63c0 2024-09-13T18:09:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.063+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f96f801c7e0 con 0x7f97000c63c0 2024-09-13T18:09:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.063+0000 7f96fd7fa700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 0x7f96e0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.063+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f96f8085880 con 0x7f97000c63c0 2024-09-13T18:09:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.063+0000 7f96fffff700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 0x7f96e0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.063+0000 7f96fffff700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 0x7f96e0068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f60 tx=0x7f96f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.071+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f96f8052b70 con 0x7f97000c63c0 2024-09-13T18:09:27.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.235+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9700157d00 con 0x7f96e0066730 2024-09-13T18:09:27.255 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.247+0000 7f96fd7fa700 1 -- 172.21.15.88:0/1466763863 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289059 (secure 0 0 0) 0x7f9700157d00 con 0x7f96e0066730 2024-09-13T18:09:27.259 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 msgr2=0x7f96e0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 0x7f96e0068bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f96f0000f60 tx=0x7f96f0009040 comp rx=0 tx=0).stop 2024-09-13T18:09:27.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 msgr2=0x7f97000c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f97000cb850 tx=0x7f96f8004af0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 shutdown_connections 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f96e0066730 0x7f96e0068bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97000c63c0 0x7f97000c0660 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f97000c5fe0 0x7f97001f34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 --2- 172.21.15.88:0/1466763863 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f97000c5790 0x7f97001f6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 >> 172.21.15.88:0/1466763863 conn(0x7f97000ca790 msgr2=0x7f9700071880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 shutdown_connections 2024-09-13T18:09:27.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.255+0000 7f97064e3700 1 -- 172.21.15.88:0/1466763863 wait complete. 2024-09-13T18:09:27.264 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:09:27.274 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-13T18:09:27.042488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10065,"ondisk_log_size":10065,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300512,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":297971,"kb_avail":754674208,"statfs":{"total":773094113280,"available":772786388992,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":305122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737402165,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2580,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004613"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.244766+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:20.244766+0000","last_peered":"2024-09-13T18:09:20.244766+0000","last_clean":"2024-09-13T18:09:20.244766+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:20.244766+0000","last_undegraded":"2024-09-13T18:09:20.244766+0000","last_fullsized":"2024-09-13T18:09:20.244766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218109+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:09:20.218109+0000","last_peered":"2024-09-13T18:09:20.218109+0000","last_clean":"2024-09-13T18:09:20.218109+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:20.218109+0000","last_undegraded":"2024-09-13T18:09:20.218109+0000","last_fullsized":"2024-09-13T18:09:20.218109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.214676+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:09:20.214676+0000","last_peered":"2024-09-13T18:09:20.214676+0000","last_clean":"2024-09-13T18:09:20.214676+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:20.214676+0000","last_undegraded":"2024-09-13T18:09:20.214676+0000","last_fullsized":"2024-09-13T18:09:20.214676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245923+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:20.245923+0000","last_peered":"2024-09-13T18:09:20.245923+0000","last_clean":"2024-09-13T18:09:20.245923+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:20.245923+0000","last_undegraded":"2024-09-13T18:09:20.245923+0000","last_fullsized":"2024-09-13T18:09:20.245923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234666+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:20.234666+0000","last_peered":"2024-09-13T18:09:20.234666+0000","last_clean":"2024-09-13T18:09:20.234666+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:20.234666+0000","last_undegraded":"2024-09-13T18:09:20.234666+0000","last_fullsized":"2024-09-13T18:09:20.234666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.242592+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.242592+0000","last_peered":"2024-09-13T18:09:20.242592+0000","last_clean":"2024-09-13T18:09:20.242592+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.242592+0000","last_undegraded":"2024-09-13T18:09:20.242592+0000","last_fullsized":"2024-09-13T18:09:20.242592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.224958+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:09:20.224958+0000","last_peered":"2024-09-13T18:09:20.224958+0000","last_clean":"2024-09-13T18:09:20.224958+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:09:20.224958+0000","last_undegraded":"2024-09-13T18:09:20.224958+0000","last_fullsized":"2024-09-13T18:09:20.224958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":207,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234083+0000","last_change":"2024-09-13T18:06:16.752158+0000","last_active":"2024-09-13T18:09:20.234083+0000","last_peered":"2024-09-13T18:09:20.234083+0000","last_clean":"2024-09-13T18:09:20.234083+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:20.234083+0000","last_undegraded":"2024-09-13T18:09:20.234083+0000","last_fullsized":"2024-09-13T18:09:20.234083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:39.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247889+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:09:20.247889+0000","last_peered":"2024-09-13T18:09:20.247889+0000","last_clean":"2024-09-13T18:09:20.247889+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:09:20.247889+0000","last_undegraded":"2024-09-13T18:09:20.247889+0000","last_fullsized":"2024-09-13T18:09:20.247889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231457+0000","last_change":"2024-09-13T18:06:16.720806+0000","last_active":"2024-09-13T18:09:20.231457+0000","last_peered":"2024-09-13T18:09:20.231457+0000","last_clean":"2024-09-13T18:09:20.231457+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:20.231457+0000","last_undegraded":"2024-09-13T18:09:20.231457+0000","last_fullsized":"2024-09-13T18:09:20.231457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:00.555081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246616+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:09:20.246616+0000","last_peered":"2024-09-13T18:09:20.246616+0000","last_clean":"2024-09-13T18:09:20.246616+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:20.246616+0000","last_undegraded":"2024-09-13T18:09:20.246616+0000","last_fullsized":"2024-09-13T18:09:20.246616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227837+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:09:20.227837+0000","last_peered":"2024-09-13T18:09:20.227837+0000","last_clean":"2024-09-13T18:09:20.227837+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:20.227837+0000","last_undegraded":"2024-09-13T18:09:20.227837+0000","last_fullsized":"2024-09-13T18:09:20.227837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.237119+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:09:20.237119+0000","last_peered":"2024-09-13T18:09:20.237119+0000","last_clean":"2024-09-13T18:09:20.237119+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:09:20.237119+0000","last_undegraded":"2024-09-13T18:09:20.237119+0000","last_fullsized":"2024-09-13T18:09:20.237119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222864+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:09:20.222864+0000","last_peered":"2024-09-13T18:09:20.222864+0000","last_clean":"2024-09-13T18:09:20.222864+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:20.222864+0000","last_undegraded":"2024-09-13T18:09:20.222864+0000","last_fullsized":"2024-09-13T18:09:20.222864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.225712+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:09:20.225712+0000","last_peered":"2024-09-13T18:09:20.225712+0000","last_clean":"2024-09-13T18:09:20.225712+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:20.225712+0000","last_undegraded":"2024-09-13T18:09:20.225712+0000","last_fullsized":"2024-09-13T18:09:20.225712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239166+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:09:20.239166+0000","last_peered":"2024-09-13T18:09:20.239166+0000","last_clean":"2024-09-13T18:09:20.239166+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:20.239166+0000","last_undegraded":"2024-09-13T18:09:20.239166+0000","last_fullsized":"2024-09-13T18:09:20.239166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246407+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:09:20.246407+0000","last_peered":"2024-09-13T18:09:20.246407+0000","last_clean":"2024-09-13T18:09:20.246407+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:20.246407+0000","last_undegraded":"2024-09-13T18:09:20.246407+0000","last_fullsized":"2024-09-13T18:09:20.246407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235075+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:09:20.235075+0000","last_peered":"2024-09-13T18:09:20.235075+0000","last_clean":"2024-09-13T18:09:20.235075+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:20.235075+0000","last_undegraded":"2024-09-13T18:09:20.235075+0000","last_fullsized":"2024-09-13T18:09:20.235075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227939+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:20.227939+0000","last_peered":"2024-09-13T18:09:20.227939+0000","last_clean":"2024-09-13T18:09:20.227939+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:20.227939+0000","last_undegraded":"2024-09-13T18:09:20.227939+0000","last_fullsized":"2024-09-13T18:09:20.227939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228172+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:09:20.228172+0000","last_peered":"2024-09-13T18:09:20.228172+0000","last_clean":"2024-09-13T18:09:20.228172+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:20.228172+0000","last_undegraded":"2024-09-13T18:09:20.228172+0000","last_fullsized":"2024-09-13T18:09:20.228172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229849+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:09:20.229849+0000","last_peered":"2024-09-13T18:09:20.229849+0000","last_clean":"2024-09-13T18:09:20.229849+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:20.229849+0000","last_undegraded":"2024-09-13T18:09:20.229849+0000","last_fullsized":"2024-09-13T18:09:20.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245252+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:09:20.245252+0000","last_peered":"2024-09-13T18:09:20.245252+0000","last_clean":"2024-09-13T18:09:20.245252+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:09:20.245252+0000","last_undegraded":"2024-09-13T18:09:20.245252+0000","last_fullsized":"2024-09-13T18:09:20.245252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230542+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:09:20.230542+0000","last_peered":"2024-09-13T18:09:20.230542+0000","last_clean":"2024-09-13T18:09:20.230542+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:20.230542+0000","last_undegraded":"2024-09-13T18:09:20.230542+0000","last_fullsized":"2024-09-13T18:09:20.230542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239102+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:09:20.239102+0000","last_peered":"2024-09-13T18:09:20.239102+0000","last_clean":"2024-09-13T18:09:20.239102+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:20.239102+0000","last_undegraded":"2024-09-13T18:09:20.239102+0000","last_fullsized":"2024-09-13T18:09:20.239102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230200+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:09:20.230200+0000","last_peered":"2024-09-13T18:09:20.230200+0000","last_clean":"2024-09-13T18:09:20.230200+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:20.230200+0000","last_undegraded":"2024-09-13T18:09:20.230200+0000","last_fullsized":"2024-09-13T18:09:20.230200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":211,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233195+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:09:20.233195+0000","last_peered":"2024-09-13T18:09:20.233195+0000","last_clean":"2024-09-13T18:09:20.233195+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:20.233195+0000","last_undegraded":"2024-09-13T18:09:20.233195+0000","last_fullsized":"2024-09-13T18:09:20.233195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231150+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:09:20.231150+0000","last_peered":"2024-09-13T18:09:20.231150+0000","last_clean":"2024-09-13T18:09:20.231150+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:20.231150+0000","last_undegraded":"2024-09-13T18:09:20.231150+0000","last_fullsized":"2024-09-13T18:09:20.231150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":146,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232446+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:09:20.232446+0000","last_peered":"2024-09-13T18:09:20.232446+0000","last_clean":"2024-09-13T18:09:20.232446+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:20.232446+0000","last_undegraded":"2024-09-13T18:09:20.232446+0000","last_fullsized":"2024-09-13T18:09:20.232446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235269+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:09:20.235269+0000","last_peered":"2024-09-13T18:09:20.235269+0000","last_clean":"2024-09-13T18:09:20.235269+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:20.235269+0000","last_undegraded":"2024-09-13T18:09:20.235269+0000","last_fullsized":"2024-09-13T18:09:20.235269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231767+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:09:20.231767+0000","last_peered":"2024-09-13T18:09:20.231767+0000","last_clean":"2024-09-13T18:09:20.231767+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:20.231767+0000","last_undegraded":"2024-09-13T18:09:20.231767+0000","last_fullsized":"2024-09-13T18:09:20.231767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239797+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:09:20.239797+0000","last_peered":"2024-09-13T18:09:20.239797+0000","last_clean":"2024-09-13T18:09:20.239797+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:20.239797+0000","last_undegraded":"2024-09-13T18:09:20.239797+0000","last_fullsized":"2024-09-13T18:09:20.239797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228817+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:09:20.228817+0000","last_peered":"2024-09-13T18:09:20.228817+0000","last_clean":"2024-09-13T18:09:20.228817+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:20.228817+0000","last_undegraded":"2024-09-13T18:09:20.228817+0000","last_fullsized":"2024-09-13T18:09:20.228817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.223691+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:09:20.223691+0000","last_peered":"2024-09-13T18:09:20.223691+0000","last_clean":"2024-09-13T18:09:20.223691+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:20.223691+0000","last_undegraded":"2024-09-13T18:09:20.223691+0000","last_fullsized":"2024-09-13T18:09:20.223691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:08:00.056573+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:08:00.056573+0000","last_peered":"2024-09-13T18:08:00.056573+0000","last_clean":"2024-09-13T18:08:00.056573+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:08:00.056573+0000","last_undegraded":"2024-09-13T18:08:00.056573+0000","last_fullsized":"2024-09-13T18:08:00.056573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229461+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:09:20.229461+0000","last_peered":"2024-09-13T18:09:20.229461+0000","last_clean":"2024-09-13T18:09:20.229461+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:20.229461+0000","last_undegraded":"2024-09-13T18:09:20.229461+0000","last_fullsized":"2024-09-13T18:09:20.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.716994+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:06:16.716994+0000","last_peered":"2024-09-13T18:06:16.716994+0000","last_clean":"2024-09-13T18:06:16.716994+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:06:16.716994+0000","last_undegraded":"2024-09-13T18:06:16.716994+0000","last_fullsized":"2024-09-13T18:06:16.716994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.713078+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:06:16.713078+0000","last_peered":"2024-09-13T18:06:16.713078+0000","last_clean":"2024-09-13T18:06:16.713078+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:06:16.713078+0000","last_undegraded":"2024-09-13T18:06:16.713078+0000","last_fullsized":"2024-09-13T18:06:16.713078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233805+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:09:20.233805+0000","last_peered":"2024-09-13T18:09:20.233805+0000","last_clean":"2024-09-13T18:09:20.233805+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:20.233805+0000","last_undegraded":"2024-09-13T18:09:20.233805+0000","last_fullsized":"2024-09-13T18:09:20.233805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222469+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:06:17.222469+0000","last_peered":"2024-09-13T18:06:17.222469+0000","last_clean":"2024-09-13T18:06:17.222469+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:06:17.222469+0000","last_undegraded":"2024-09-13T18:06:17.222469+0000","last_fullsized":"2024-09-13T18:06:17.222469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231469+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:09:20.231469+0000","last_peered":"2024-09-13T18:09:20.231469+0000","last_clean":"2024-09-13T18:09:20.231469+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:20.231469+0000","last_undegraded":"2024-09-13T18:09:20.231469+0000","last_fullsized":"2024-09-13T18:09:20.231469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:55.052228+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:07:55.052228+0000","last_peered":"2024-09-13T18:07:55.052228+0000","last_clean":"2024-09-13T18:07:55.052228+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:07:55.052228+0000","last_undegraded":"2024-09-13T18:07:55.052228+0000","last_fullsized":"2024-09-13T18:07:55.052228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246708+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:09:20.246708+0000","last_peered":"2024-09-13T18:09:20.246708+0000","last_clean":"2024-09-13T18:09:20.246708+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:20.246708+0000","last_undegraded":"2024-09-13T18:09:20.246708+0000","last_fullsized":"2024-09-13T18:09:20.246708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223568+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:06:17.223568+0000","last_peered":"2024-09-13T18:06:17.223568+0000","last_clean":"2024-09-13T18:06:17.223568+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:06:17.223568+0000","last_undegraded":"2024-09-13T18:06:17.223568+0000","last_fullsized":"2024-09-13T18:06:17.223568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241669+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:09:20.241669+0000","last_peered":"2024-09-13T18:09:20.241669+0000","last_clean":"2024-09-13T18:09:20.241669+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:20.241669+0000","last_undegraded":"2024-09-13T18:09:20.241669+0000","last_fullsized":"2024-09-13T18:09:20.241669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.720977+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:09:14.720977+0000","last_peered":"2024-09-13T18:09:14.720977+0000","last_clean":"2024-09-13T18:09:14.720977+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:14.720977+0000","last_undegraded":"2024-09-13T18:09:14.720977+0000","last_fullsized":"2024-09-13T18:09:14.720977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236337+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:09:20.236337+0000","last_peered":"2024-09-13T18:09:20.236337+0000","last_clean":"2024-09-13T18:09:20.236337+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:20.236337+0000","last_undegraded":"2024-09-13T18:09:20.236337+0000","last_fullsized":"2024-09-13T18:09:20.236337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'95","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.249817+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:09:20.249817+0000","last_peered":"2024-09-13T18:09:20.249817+0000","last_clean":"2024-09-13T18:09:20.249817+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:20.249817+0000","last_undegraded":"2024-09-13T18:09:20.249817+0000","last_fullsized":"2024-09-13T18:09:20.249817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231850+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:09:20.231850+0000","last_peered":"2024-09-13T18:09:20.231850+0000","last_clean":"2024-09-13T18:09:20.231850+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:09:20.231850+0000","last_undegraded":"2024-09-13T18:09:20.231850+0000","last_fullsized":"2024-09-13T18:09:20.231850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223524+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:06:17.223524+0000","last_peered":"2024-09-13T18:06:17.223524+0000","last_clean":"2024-09-13T18:06:17.223524+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:06:17.223524+0000","last_undegraded":"2024-09-13T18:06:17.223524+0000","last_fullsized":"2024-09-13T18:06:17.223524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.226414+0000","last_change":"2024-09-13T18:06:17.149866+0000","last_active":"2024-09-13T18:09:20.226414+0000","last_peered":"2024-09-13T18:09:20.226414+0000","last_clean":"2024-09-13T18:09:20.226414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:20.226414+0000","last_undegraded":"2024-09-13T18:09:20.226414+0000","last_fullsized":"2024-09-13T18:09:20.226414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:10.096089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223854+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:06:17.223854+0000","last_peered":"2024-09-13T18:06:17.223854+0000","last_clean":"2024-09-13T18:06:17.223854+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:06:17.223854+0000","last_undegraded":"2024-09-13T18:06:17.223854+0000","last_fullsized":"2024-09-13T18:06:17.223854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239477+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:09:20.239477+0000","last_peered":"2024-09-13T18:09:20.239477+0000","last_clean":"2024-09-13T18:09:20.239477+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:20.239477+0000","last_undegraded":"2024-09-13T18:09:20.239477+0000","last_fullsized":"2024-09-13T18:09:20.239477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.717003+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:06:16.717003+0000","last_peered":"2024-09-13T18:06:16.717003+0000","last_clean":"2024-09-13T18:06:16.717003+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:06:16.717003+0000","last_undegraded":"2024-09-13T18:06:16.717003+0000","last_fullsized":"2024-09-13T18:06:16.717003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221064+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:09:20.221064+0000","last_peered":"2024-09-13T18:09:20.221064+0000","last_clean":"2024-09-13T18:09:20.221064+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:20.221064+0000","last_undegraded":"2024-09-13T18:09:20.221064+0000","last_fullsized":"2024-09-13T18:09:20.221064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:46.050658+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:07:46.050658+0000","last_peered":"2024-09-13T18:07:46.050658+0000","last_clean":"2024-09-13T18:07:46.050658+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:07:46.050658+0000","last_undegraded":"2024-09-13T18:07:46.050658+0000","last_fullsized":"2024-09-13T18:07:46.050658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232146+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:09:20.232146+0000","last_peered":"2024-09-13T18:09:20.232146+0000","last_clean":"2024-09-13T18:09:20.232146+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:20.232146+0000","last_undegraded":"2024-09-13T18:09:20.232146+0000","last_fullsized":"2024-09-13T18:09:20.232146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.225545+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:06:17.225545+0000","last_peered":"2024-09-13T18:06:17.225545+0000","last_clean":"2024-09-13T18:06:17.225545+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:06:17.225545+0000","last_undegraded":"2024-09-13T18:06:17.225545+0000","last_fullsized":"2024-09-13T18:06:17.225545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231559+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:09:20.231559+0000","last_peered":"2024-09-13T18:09:20.231559+0000","last_clean":"2024-09-13T18:09:20.231559+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:20.231559+0000","last_undegraded":"2024-09-13T18:09:20.231559+0000","last_fullsized":"2024-09-13T18:09:20.231559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714515+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:06:16.714515+0000","last_peered":"2024-09-13T18:06:16.714515+0000","last_clean":"2024-09-13T18:06:16.714515+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:06:16.714515+0000","last_undegraded":"2024-09-13T18:06:16.714515+0000","last_fullsized":"2024-09-13T18:06:16.714515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247445+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:09:20.247445+0000","last_peered":"2024-09-13T18:09:20.247445+0000","last_clean":"2024-09-13T18:09:20.247445+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:20.247445+0000","last_undegraded":"2024-09-13T18:09:20.247445+0000","last_fullsized":"2024-09-13T18:09:20.247445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.750024+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:06:16.750024+0000","last_peered":"2024-09-13T18:06:16.750024+0000","last_clean":"2024-09-13T18:06:16.750024+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:06:16.750024+0000","last_undegraded":"2024-09-13T18:06:16.750024+0000","last_fullsized":"2024-09-13T18:06:16.750024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222327+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:20.222327+0000","last_peered":"2024-09-13T18:09:20.222327+0000","last_clean":"2024-09-13T18:09:20.222327+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:20.222327+0000","last_undegraded":"2024-09-13T18:09:20.222327+0000","last_fullsized":"2024-09-13T18:09:20.222327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714215+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:06:16.714215+0000","last_peered":"2024-09-13T18:06:16.714215+0000","last_clean":"2024-09-13T18:06:16.714215+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:06:16.714215+0000","last_undegraded":"2024-09-13T18:06:16.714215+0000","last_fullsized":"2024-09-13T18:06:16.714215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240140+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:09:20.240140+0000","last_peered":"2024-09-13T18:09:20.240140+0000","last_clean":"2024-09-13T18:09:20.240140+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:20.240140+0000","last_undegraded":"2024-09-13T18:09:20.240140+0000","last_fullsized":"2024-09-13T18:09:20.240140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:20.054603+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:07:20.054603+0000","last_peered":"2024-09-13T18:07:20.054603+0000","last_clean":"2024-09-13T18:07:20.054603+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:07:20.054603+0000","last_undegraded":"2024-09-13T18:07:20.054603+0000","last_fullsized":"2024-09-13T18:07:20.054603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222824+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:06:17.222824+0000","last_peered":"2024-09-13T18:06:17.222824+0000","last_clean":"2024-09-13T18:06:17.222824+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:06:17.222824+0000","last_undegraded":"2024-09-13T18:06:17.222824+0000","last_fullsized":"2024-09-13T18:06:17.222824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239918+0000","last_change":"2024-09-13T18:06:17.227202+0000","last_active":"2024-09-13T18:09:20.239918+0000","last_peered":"2024-09-13T18:09:20.239918+0000","last_clean":"2024-09-13T18:09:20.239918+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:20.239918+0000","last_undegraded":"2024-09-13T18:09:20.239918+0000","last_fullsized":"2024-09-13T18:09:20.239918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:12.726841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146386+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:06:17.146386+0000","last_peered":"2024-09-13T18:06:17.146386+0000","last_clean":"2024-09-13T18:06:17.146386+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:06:17.146386+0000","last_undegraded":"2024-09-13T18:06:17.146386+0000","last_fullsized":"2024-09-13T18:06:17.146386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229227+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:09:20.229227+0000","last_peered":"2024-09-13T18:09:20.229227+0000","last_clean":"2024-09-13T18:09:20.229227+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:20.229227+0000","last_undegraded":"2024-09-13T18:09:20.229227+0000","last_fullsized":"2024-09-13T18:09:20.229227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.707089+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:09:18.707089+0000","last_peered":"2024-09-13T18:09:18.707089+0000","last_clean":"2024-09-13T18:09:18.707089+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:18.707089+0000","last_undegraded":"2024-09-13T18:09:18.707089+0000","last_fullsized":"2024-09-13T18:09:18.707089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218962+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:09:20.218962+0000","last_peered":"2024-09-13T18:09:20.218962+0000","last_clean":"2024-09-13T18:09:20.218962+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:20.218962+0000","last_undegraded":"2024-09-13T18:09:20.218962+0000","last_fullsized":"2024-09-13T18:09:20.218962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223846+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:06:17.223846+0000","last_peered":"2024-09-13T18:06:17.223846+0000","last_clean":"2024-09-13T18:06:17.223846+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:06:17.223846+0000","last_undegraded":"2024-09-13T18:06:17.223846+0000","last_fullsized":"2024-09-13T18:06:17.223846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227385+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:09:20.227385+0000","last_peered":"2024-09-13T18:09:20.227385+0000","last_clean":"2024-09-13T18:09:20.227385+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:20.227385+0000","last_undegraded":"2024-09-13T18:09:20.227385+0000","last_fullsized":"2024-09-13T18:09:20.227385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749841+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:06:16.749841+0000","last_peered":"2024-09-13T18:06:16.749841+0000","last_clean":"2024-09-13T18:06:16.749841+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:06:16.749841+0000","last_undegraded":"2024-09-13T18:06:16.749841+0000","last_fullsized":"2024-09-13T18:06:16.749841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240024+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:09:20.240024+0000","last_peered":"2024-09-13T18:09:20.240024+0000","last_clean":"2024-09-13T18:09:20.240024+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:20.240024+0000","last_undegraded":"2024-09-13T18:09:20.240024+0000","last_fullsized":"2024-09-13T18:09:20.240024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.147552+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:06:17.147552+0000","last_peered":"2024-09-13T18:06:17.147552+0000","last_clean":"2024-09-13T18:06:17.147552+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:06:17.147552+0000","last_undegraded":"2024-09-13T18:06:17.147552+0000","last_fullsized":"2024-09-13T18:06:17.147552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.219097+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:09:20.219097+0000","last_peered":"2024-09-13T18:09:20.219097+0000","last_clean":"2024-09-13T18:09:20.219097+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:20.219097+0000","last_undegraded":"2024-09-13T18:09:20.219097+0000","last_fullsized":"2024-09-13T18:09:20.219097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:16.510128+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:09:16.510128+0000","last_peered":"2024-09-13T18:09:16.510128+0000","last_clean":"2024-09-13T18:09:16.510128+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:16.510128+0000","last_undegraded":"2024-09-13T18:09:16.510128+0000","last_fullsized":"2024-09-13T18:09:16.510128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240595+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:09:20.240595+0000","last_peered":"2024-09-13T18:09:20.240595+0000","last_clean":"2024-09-13T18:09:20.240595+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:20.240595+0000","last_undegraded":"2024-09-13T18:09:20.240595+0000","last_fullsized":"2024-09-13T18:09:20.240595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:40.049606+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:07:40.049606+0000","last_peered":"2024-09-13T18:07:40.049606+0000","last_clean":"2024-09-13T18:07:40.049606+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:07:40.049606+0000","last_undegraded":"2024-09-13T18:07:40.049606+0000","last_fullsized":"2024-09-13T18:07:40.049606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221838+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:09:20.221838+0000","last_peered":"2024-09-13T18:09:20.221838+0000","last_clean":"2024-09-13T18:09:20.221838+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:20.221838+0000","last_undegraded":"2024-09-13T18:09:20.221838+0000","last_fullsized":"2024-09-13T18:09:20.221838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146357+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:06:17.146357+0000","last_peered":"2024-09-13T18:06:17.146357+0000","last_clean":"2024-09-13T18:06:17.146357+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:06:17.146357+0000","last_undegraded":"2024-09-13T18:06:17.146357+0000","last_fullsized":"2024-09-13T18:06:17.146357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.196059+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:09:20.196059+0000","last_peered":"2024-09-13T18:09:20.196059+0000","last_clean":"2024-09-13T18:09:20.196059+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:20.196059+0000","last_undegraded":"2024-09-13T18:09:20.196059+0000","last_fullsized":"2024-09-13T18:09:20.196059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749639+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:06:16.749639+0000","last_peered":"2024-09-13T18:06:16.749639+0000","last_clean":"2024-09-13T18:06:16.749639+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:06:16.749639+0000","last_undegraded":"2024-09-13T18:06:16.749639+0000","last_fullsized":"2024-09-13T18:06:16.749639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232322+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:09:20.232322+0000","last_peered":"2024-09-13T18:09:20.232322+0000","last_clean":"2024-09-13T18:09:20.232322+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:20.232322+0000","last_undegraded":"2024-09-13T18:09:20.232322+0000","last_fullsized":"2024-09-13T18:09:20.232322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749649+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:06:16.749649+0000","last_peered":"2024-09-13T18:06:16.749649+0000","last_clean":"2024-09-13T18:06:16.749649+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:06:16.749649+0000","last_undegraded":"2024-09-13T18:06:16.749649+0000","last_fullsized":"2024-09-13T18:06:16.749649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236736+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:09:20.236736+0000","last_peered":"2024-09-13T18:09:20.236736+0000","last_clean":"2024-09-13T18:09:20.236736+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:20.236736+0000","last_undegraded":"2024-09-13T18:09:20.236736+0000","last_fullsized":"2024-09-13T18:09:20.236736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:45.060694+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:07:45.060694+0000","last_peered":"2024-09-13T18:07:45.060694+0000","last_clean":"2024-09-13T18:07:45.060694+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:07:45.060694+0000","last_undegraded":"2024-09-13T18:07:45.060694+0000","last_fullsized":"2024-09-13T18:07:45.060694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":141,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228017+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:09:20.228017+0000","last_peered":"2024-09-13T18:09:20.228017+0000","last_clean":"2024-09-13T18:09:20.228017+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:20.228017+0000","last_undegraded":"2024-09-13T18:09:20.228017+0000","last_fullsized":"2024-09-13T18:09:20.228017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245337+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:09:20.245337+0000","last_peered":"2024-09-13T18:09:20.245337+0000","last_clean":"2024-09-13T18:09:20.245337+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:09:20.245337+0000","last_undegraded":"2024-09-13T18:09:20.245337+0000","last_fullsized":"2024-09-13T18:09:20.245337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146813+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:06:17.146813+0000","last_peered":"2024-09-13T18:06:17.146813+0000","last_clean":"2024-09-13T18:06:17.146813+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:06:17.146813+0000","last_undegraded":"2024-09-13T18:06:17.146813+0000","last_fullsized":"2024-09-13T18:06:17.146813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245976+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.245976+0000","last_peered":"2024-09-13T18:09:20.245976+0000","last_clean":"2024-09-13T18:09:20.245976+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.245976+0000","last_undegraded":"2024-09-13T18:09:20.245976+0000","last_fullsized":"2024-09-13T18:09:20.245976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:53.633949+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:07:53.633949+0000","last_peered":"2024-09-13T18:07:53.633949+0000","last_clean":"2024-09-13T18:07:53.633949+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:07:53.633949+0000","last_undegraded":"2024-09-13T18:07:53.633949+0000","last_fullsized":"2024-09-13T18:07:53.633949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241744+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:09:20.241744+0000","last_peered":"2024-09-13T18:09:20.241744+0000","last_clean":"2024-09-13T18:09:20.241744+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:20.241744+0000","last_undegraded":"2024-09-13T18:09:20.241744+0000","last_fullsized":"2024-09-13T18:09:20.241744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714885+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:06:16.714885+0000","last_peered":"2024-09-13T18:06:16.714885+0000","last_clean":"2024-09-13T18:06:16.714885+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:06:16.714885+0000","last_undegraded":"2024-09-13T18:06:16.714885+0000","last_fullsized":"2024-09-13T18:06:16.714885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233883+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:09:20.233883+0000","last_peered":"2024-09-13T18:09:20.233883+0000","last_clean":"2024-09-13T18:09:20.233883+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:20.233883+0000","last_undegraded":"2024-09-13T18:09:20.233883+0000","last_fullsized":"2024-09-13T18:09:20.233883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223509+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:06:17.223509+0000","last_peered":"2024-09-13T18:06:17.223509+0000","last_clean":"2024-09-13T18:06:17.223509+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:06:17.223509+0000","last_undegraded":"2024-09-13T18:06:17.223509+0000","last_fullsized":"2024-09-13T18:06:17.223509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.65800000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.99099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.73999999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.139,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1120000000000001,"5min":1.516,"15min":1.516},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.499},"max":{"1min":3.7919999999999998,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.96699999999999997,"15min":1.0129999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2330000000000001,"5min":1.907,"15min":1.907},"last":1.03},{"interface":"front","average":{"1min":1.135,"5min":1.048,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.998,"15min":1.077},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4279999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.024,"15min":1.05},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.4539999999999997,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":1.0980000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.66200000000000003},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.73999999999999999,"5min":2.077,"15min":2.077},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":11.384,"5min":11.384,"15min":11.384},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.749},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4590000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.93799999999999994,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.181,"5min":1.347,"15min":1.347},"last":0.94999999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.319,"5min":1.452,"15min":1.452},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.006,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1990000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.222,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.377,"5min":1.46,"15min":1.46},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.93400000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.232},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96099999999999997,"15min":1.054},"min":{"1min":0.50800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.159,"5min":6.093,"15min":6.093},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.079,"15min":1.169},"min":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2849999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.86299999999999999,"15min":0.90500000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0649999999999999,"15min":1.165},"min":{"1min":0.59399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.377,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.92000000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3200000000000001,"5min":1.363,"15min":1.363},"last":1.105}]},{"osd":4,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97199999999999998,"15min":0.98599999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.177,"15min":1.278},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.45,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.032}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.169,"15min":1.2569999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.772,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.204,"15min":1.294},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.411,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.347,"15min":1.4630000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0059999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.145,"15min":1.2190000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.274,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.95199999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.92500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.198,"5min":1.222,"15min":1.222},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.98599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.84999999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.23,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.90400000000000003,"15min":0.95199999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.099},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2789999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5329999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0589999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.097,"15min":1.1259999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.552,"5min":1.621,"15min":1.621},"last":1.143}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86099999999999999,"15min":0.89200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.90700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.747},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.90700000000000003},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93400000000000005,"15min":0.96199999999999997},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0880000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0840000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97999999999999998,"15min":1.024},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.6799999999999999,"5min":1.909,"15min":1.909},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.089,"15min":1.1180000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":1.0529999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5169999999999999,"5min":1.885,"15min":1.885},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.123,"15min":1.1619999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5600000000000001,"5min":1.647,"15min":1.647},"last":1.024},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.123,"15min":1.181},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3220000000000001,"5min":1.851,"15min":1.851},"last":0.93999999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.745},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.27600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.105}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.75700000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.99299999999999999,"5min":1.798,"15min":1.798},"last":0.82799999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.88600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":1.0089999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":0.97199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0669999999999999,"5min":1.905,"15min":1.905},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.95499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1}]},{"osd":6,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0609999999999999,"15min":1.0880000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.216},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0609999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.974,"15min":1.974},"last":1.319}]},{"osd":7,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.008,"15min":1.04},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3799999999999999,"5min":1.444,"15min":1.444},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.083,"15min":1.095},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.077}]},{"osd":1,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.875},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.90400000000000003,"15min":0.95399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.121,"5min":1.173,"15min":1.173},"last":1.167}]},{"osd":2,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0720000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":1.097},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57899999999999996},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88,"5min":1.214,"15min":1.214},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.64400000000000002},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.76800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.054,"5min":2.27,"15min":2.27},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.542,"5min":2.306,"15min":2.306},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.012,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93200000000000005,"15min":0.96999999999999997},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1859999999999999,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8300000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0349999999999999,"15min":1.036},"min":{"1min":0.60399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0249999999999999,"15min":1.0649999999999999},"min":{"1min":0.57899999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.268,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0549999999999999,"15min":1.1020000000000001},"min":{"1min":0.63,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7270000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.081},{"interface":"front","average":{"1min":1.032,"5min":1.0680000000000001,"15min":1.1060000000000001},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.254,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.8759999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.133,"15min":1.1819999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.851,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:09:27.279 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:09:27.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:09:27.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 Processor -- start 2024-09-13T18:09:27.389 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 -- start start 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b00ccb10 0x7fd9b00c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00c6020 con 0x7fd9b00ccef0 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9b00c3ff0 con 0x7fd9b00c6490 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9b4f91700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00c3b30 con 0x7fd9b00ccb10 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9aeffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd9b00ccef0 0x7fd9b00c7350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36056/0 (socket says 172.21.15.88:36056) 2024-09-13T18:09:27.390 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9aeffd700 1 -- 172.21.15.88:0/2464378953 learned_addr learned my addr 172.21.15.88:0/2464378953 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:27.393 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b00ccb10 0x7fd9b00c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469983102 0 0) 0x7fd9b00c6020 con 0x7fd9b00ccef0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9980035d0 con 0x7fd9b00ccef0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098119260 0 0) 0x7fd9b00c3ff0 con 0x7fd9b00c6490 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.383+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b00c6020 con 0x7fd9b00c6490 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939822774 0 0) 0x7fd9980035d0 con 0x7fd9b00ccef0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b00ccb10 msgr2=0x7fd9b00c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b00ccb10 0x7fd9b00c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 >> v1:172.21.15.94:6789/0 conn(0x7fd9b00c6490 legacy=0x7fd9b0150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00c42d0 con 0x7fd9b00ccef0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fd9a0001670 con 0x7fd9b00ccef0 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 >> v1:172.21.15.88:6789/0 conn(0x7fd9b00ccef0 legacy=0x7fd9b00c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd998003be0 0x7fd998003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.394 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd998004870 0x7fd998004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998005230 0x7fd99800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b00c3b30 con 0x7fd998003be0 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd99800bfa0 con 0x7fd998005230 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd99800c160 con 0x7fd998004870 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b00ccb10 0x7fd9b00c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd998003be0 0x7fd998003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9aeffd700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd998004870 0x7fd998004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9affff700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998005230 0x7fd99800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 -- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd998004870 msgr2=0x7fd998004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd998004870 0x7fd998004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 -- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998005230 msgr2=0x7fd99800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998005230 0x7fd99800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 -- 172.21.15.88:0/2464378953 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9980035d0 con 0x7fd998003be0 2024-09-13T18:09:27.395 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd998003be0 0x7fd998003fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9b006dd90 tx=0x7fd9980058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2183c3811d222bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4004030 con 0x7fd998003be0 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a4004190 con 0x7fd998003be0 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9ae7fc700 1 -- 172.21.15.88:0/2464378953 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a4004540 con 0x7fd998003be0 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 -- 172.21.15.88:0/2464378953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd998003be0 msgr2=0x7fd998003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/2464378953 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd998003be0 0x7fd998003fe0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd9b006dd90 tx=0x7fd9980058a0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9affff700 1 -- 172.21.15.88:0/2464378953 reap_dead start 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 -- 172.21.15.88:0/2464378953 shutdown_connections 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 -- 172.21.15.88:0/2464378953 >> 172.21.15.88:0/2464378953 conn(0x7fd9b0066090 msgr2=0x7fd9b0066470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 -- 172.21.15.88:0/2464378953 shutdown_connections 2024-09-13T18:09:27.396 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.387+0000 7fd9b4f91700 1 -- 172.21.15.88:0/2464378953 wait complete. 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 Processor -- start 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- start start 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998003be0 0x7fd9b0142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 0x7fd9b01df750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0147000 con 0x7fd9b014d920 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b01dde90 con 0x7fd998003be0 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b0146a40 con 0x7fd9b01dee00 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59680/0 (socket says 172.21.15.88:59680) 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 -- 172.21.15.88:0/983856349 learned_addr learned my addr 172.21.15.88:0/983856349 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9affff700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 0x7fd9b01df750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998003be0 0x7fd9b0142700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 -- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 msgr2=0x7fd9b01df750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 0x7fd9b01df750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 -- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998003be0 msgr2=0x7fd9b0142700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998003be0 0x7fd9b0142700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 -- 172.21.15.88:0/983856349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0146d20 con 0x7fd9b014d920 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9affff700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 0x7fd9b01df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9aeffd700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001050 tx=0x7fd9a00075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000f6c0 con 0x7fd9b014d920 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a000f860 con 0x7fd9b014d920 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b01dd840 con 0x7fd9b014d920 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a000fc10 con 0x7fd9b014d920 2024-09-13T18:09:27.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.391+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b0142fb0 con 0x7fd9b014d920 2024-09-13T18:09:27.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.395+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b01dd6a0 con 0x7fd9b014d920 2024-09-13T18:09:27.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.395+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fd9a000fd70 con 0x7fd9b014d920 2024-09-13T18:09:27.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.399+0000 7fd997fff700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 0x7fd99c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.399+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd9a0084920 con 0x7fd9b014d920 2024-09-13T18:09:27.403 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.399+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 0x7fd99c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.399+0000 7fd9af7fe700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 0x7fd99c068c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4016040 tx=0x7fd9a4008070 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.399+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fd9a0051bf0 con 0x7fd9b014d920 2024-09-13T18:09:27.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.567+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9b006ea80 con 0x7fd99c066760 2024-09-13T18:09:27.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.583+0000 7fd997fff700 1 -- 172.21.15.88:0/983856349 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289059 (secure 0 0 0) 0x7fd9a4004300 con 0x7fd99c066760 2024-09-13T18:09:27.592 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:27.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 msgr2=0x7fd99c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 0x7fd99c068c20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4016040 tx=0x7fd9a4008070 comp rx=0 tx=0).stop 2024-09-13T18:09:27.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 msgr2=0x7fd9b01de8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001050 tx=0x7fd9a00075f0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 shutdown_connections 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fd99c066760 0x7fd99c068c20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9b01dee00 0x7fd9b01df750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9b014d920 0x7fd9b01de8c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 --2- 172.21.15.88:0/983856349 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd998003be0 0x7fd9b0142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 >> 172.21.15.88:0/983856349 conn(0x7fd9b0066090 msgr2=0x7fd9b006ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 shutdown_connections 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.587+0000 7fd9b4f91700 1 -- 172.21.15.88:0/983856349 wait complete. 2024-09-13T18:09:27.595 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:09:27.608 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-13T18:09:27.042488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10065,"ondisk_log_size":10065,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300512,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":297971,"kb_avail":754674208,"statfs":{"total":773094113280,"available":772786388992,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":305122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737402165,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-5120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2580,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004613"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.244766+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:20.244766+0000","last_peered":"2024-09-13T18:09:20.244766+0000","last_clean":"2024-09-13T18:09:20.244766+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:20.244766+0000","last_undegraded":"2024-09-13T18:09:20.244766+0000","last_fullsized":"2024-09-13T18:09:20.244766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218109+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:09:20.218109+0000","last_peered":"2024-09-13T18:09:20.218109+0000","last_clean":"2024-09-13T18:09:20.218109+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:20.218109+0000","last_undegraded":"2024-09-13T18:09:20.218109+0000","last_fullsized":"2024-09-13T18:09:20.218109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.214676+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:09:20.214676+0000","last_peered":"2024-09-13T18:09:20.214676+0000","last_clean":"2024-09-13T18:09:20.214676+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:20.214676+0000","last_undegraded":"2024-09-13T18:09:20.214676+0000","last_fullsized":"2024-09-13T18:09:20.214676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245923+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:20.245923+0000","last_peered":"2024-09-13T18:09:20.245923+0000","last_clean":"2024-09-13T18:09:20.245923+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:20.245923+0000","last_undegraded":"2024-09-13T18:09:20.245923+0000","last_fullsized":"2024-09-13T18:09:20.245923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234666+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:20.234666+0000","last_peered":"2024-09-13T18:09:20.234666+0000","last_clean":"2024-09-13T18:09:20.234666+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:20.234666+0000","last_undegraded":"2024-09-13T18:09:20.234666+0000","last_fullsized":"2024-09-13T18:09:20.234666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.242592+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.242592+0000","last_peered":"2024-09-13T18:09:20.242592+0000","last_clean":"2024-09-13T18:09:20.242592+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.242592+0000","last_undegraded":"2024-09-13T18:09:20.242592+0000","last_fullsized":"2024-09-13T18:09:20.242592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.224958+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:09:20.224958+0000","last_peered":"2024-09-13T18:09:20.224958+0000","last_clean":"2024-09-13T18:09:20.224958+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:09:20.224958+0000","last_undegraded":"2024-09-13T18:09:20.224958+0000","last_fullsized":"2024-09-13T18:09:20.224958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":207,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234083+0000","last_change":"2024-09-13T18:06:16.752158+0000","last_active":"2024-09-13T18:09:20.234083+0000","last_peered":"2024-09-13T18:09:20.234083+0000","last_clean":"2024-09-13T18:09:20.234083+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:20.234083+0000","last_undegraded":"2024-09-13T18:09:20.234083+0000","last_fullsized":"2024-09-13T18:09:20.234083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:39.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247889+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:09:20.247889+0000","last_peered":"2024-09-13T18:09:20.247889+0000","last_clean":"2024-09-13T18:09:20.247889+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:09:20.247889+0000","last_undegraded":"2024-09-13T18:09:20.247889+0000","last_fullsized":"2024-09-13T18:09:20.247889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231457+0000","last_change":"2024-09-13T18:06:16.720806+0000","last_active":"2024-09-13T18:09:20.231457+0000","last_peered":"2024-09-13T18:09:20.231457+0000","last_clean":"2024-09-13T18:09:20.231457+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:20.231457+0000","last_undegraded":"2024-09-13T18:09:20.231457+0000","last_fullsized":"2024-09-13T18:09:20.231457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:00.555081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246616+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:09:20.246616+0000","last_peered":"2024-09-13T18:09:20.246616+0000","last_clean":"2024-09-13T18:09:20.246616+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:20.246616+0000","last_undegraded":"2024-09-13T18:09:20.246616+0000","last_fullsized":"2024-09-13T18:09:20.246616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227837+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:09:20.227837+0000","last_peered":"2024-09-13T18:09:20.227837+0000","last_clean":"2024-09-13T18:09:20.227837+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:20.227837+0000","last_undegraded":"2024-09-13T18:09:20.227837+0000","last_fullsized":"2024-09-13T18:09:20.227837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.237119+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:09:20.237119+0000","last_peered":"2024-09-13T18:09:20.237119+0000","last_clean":"2024-09-13T18:09:20.237119+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:09:20.237119+0000","last_undegraded":"2024-09-13T18:09:20.237119+0000","last_fullsized":"2024-09-13T18:09:20.237119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222864+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:09:20.222864+0000","last_peered":"2024-09-13T18:09:20.222864+0000","last_clean":"2024-09-13T18:09:20.222864+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:20.222864+0000","last_undegraded":"2024-09-13T18:09:20.222864+0000","last_fullsized":"2024-09-13T18:09:20.222864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.225712+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:09:20.225712+0000","last_peered":"2024-09-13T18:09:20.225712+0000","last_clean":"2024-09-13T18:09:20.225712+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:20.225712+0000","last_undegraded":"2024-09-13T18:09:20.225712+0000","last_fullsized":"2024-09-13T18:09:20.225712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239166+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:09:20.239166+0000","last_peered":"2024-09-13T18:09:20.239166+0000","last_clean":"2024-09-13T18:09:20.239166+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:20.239166+0000","last_undegraded":"2024-09-13T18:09:20.239166+0000","last_fullsized":"2024-09-13T18:09:20.239166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246407+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:09:20.246407+0000","last_peered":"2024-09-13T18:09:20.246407+0000","last_clean":"2024-09-13T18:09:20.246407+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:20.246407+0000","last_undegraded":"2024-09-13T18:09:20.246407+0000","last_fullsized":"2024-09-13T18:09:20.246407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235075+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:09:20.235075+0000","last_peered":"2024-09-13T18:09:20.235075+0000","last_clean":"2024-09-13T18:09:20.235075+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:20.235075+0000","last_undegraded":"2024-09-13T18:09:20.235075+0000","last_fullsized":"2024-09-13T18:09:20.235075+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227939+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:20.227939+0000","last_peered":"2024-09-13T18:09:20.227939+0000","last_clean":"2024-09-13T18:09:20.227939+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:20.227939+0000","last_undegraded":"2024-09-13T18:09:20.227939+0000","last_fullsized":"2024-09-13T18:09:20.227939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228172+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:09:20.228172+0000","last_peered":"2024-09-13T18:09:20.228172+0000","last_clean":"2024-09-13T18:09:20.228172+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:20.228172+0000","last_undegraded":"2024-09-13T18:09:20.228172+0000","last_fullsized":"2024-09-13T18:09:20.228172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229849+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:09:20.229849+0000","last_peered":"2024-09-13T18:09:20.229849+0000","last_clean":"2024-09-13T18:09:20.229849+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:20.229849+0000","last_undegraded":"2024-09-13T18:09:20.229849+0000","last_fullsized":"2024-09-13T18:09:20.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245252+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:09:20.245252+0000","last_peered":"2024-09-13T18:09:20.245252+0000","last_clean":"2024-09-13T18:09:20.245252+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:09:20.245252+0000","last_undegraded":"2024-09-13T18:09:20.245252+0000","last_fullsized":"2024-09-13T18:09:20.245252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230542+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:09:20.230542+0000","last_peered":"2024-09-13T18:09:20.230542+0000","last_clean":"2024-09-13T18:09:20.230542+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:20.230542+0000","last_undegraded":"2024-09-13T18:09:20.230542+0000","last_fullsized":"2024-09-13T18:09:20.230542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239102+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:09:20.239102+0000","last_peered":"2024-09-13T18:09:20.239102+0000","last_clean":"2024-09-13T18:09:20.239102+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:20.239102+0000","last_undegraded":"2024-09-13T18:09:20.239102+0000","last_fullsized":"2024-09-13T18:09:20.239102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230200+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:09:20.230200+0000","last_peered":"2024-09-13T18:09:20.230200+0000","last_clean":"2024-09-13T18:09:20.230200+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:20.230200+0000","last_undegraded":"2024-09-13T18:09:20.230200+0000","last_fullsized":"2024-09-13T18:09:20.230200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":211,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233195+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:09:20.233195+0000","last_peered":"2024-09-13T18:09:20.233195+0000","last_clean":"2024-09-13T18:09:20.233195+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:20.233195+0000","last_undegraded":"2024-09-13T18:09:20.233195+0000","last_fullsized":"2024-09-13T18:09:20.233195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231150+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:09:20.231150+0000","last_peered":"2024-09-13T18:09:20.231150+0000","last_clean":"2024-09-13T18:09:20.231150+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:20.231150+0000","last_undegraded":"2024-09-13T18:09:20.231150+0000","last_fullsized":"2024-09-13T18:09:20.231150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":146,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232446+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:09:20.232446+0000","last_peered":"2024-09-13T18:09:20.232446+0000","last_clean":"2024-09-13T18:09:20.232446+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:20.232446+0000","last_undegraded":"2024-09-13T18:09:20.232446+0000","last_fullsized":"2024-09-13T18:09:20.232446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235269+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:09:20.235269+0000","last_peered":"2024-09-13T18:09:20.235269+0000","last_clean":"2024-09-13T18:09:20.235269+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:20.235269+0000","last_undegraded":"2024-09-13T18:09:20.235269+0000","last_fullsized":"2024-09-13T18:09:20.235269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231767+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:09:20.231767+0000","last_peered":"2024-09-13T18:09:20.231767+0000","last_clean":"2024-09-13T18:09:20.231767+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:20.231767+0000","last_undegraded":"2024-09-13T18:09:20.231767+0000","last_fullsized":"2024-09-13T18:09:20.231767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239797+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:09:20.239797+0000","last_peered":"2024-09-13T18:09:20.239797+0000","last_clean":"2024-09-13T18:09:20.239797+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:20.239797+0000","last_undegraded":"2024-09-13T18:09:20.239797+0000","last_fullsized":"2024-09-13T18:09:20.239797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228817+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:09:20.228817+0000","last_peered":"2024-09-13T18:09:20.228817+0000","last_clean":"2024-09-13T18:09:20.228817+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:20.228817+0000","last_undegraded":"2024-09-13T18:09:20.228817+0000","last_fullsized":"2024-09-13T18:09:20.228817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.223691+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:09:20.223691+0000","last_peered":"2024-09-13T18:09:20.223691+0000","last_clean":"2024-09-13T18:09:20.223691+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:20.223691+0000","last_undegraded":"2024-09-13T18:09:20.223691+0000","last_fullsized":"2024-09-13T18:09:20.223691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:08:00.056573+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:08:00.056573+0000","last_peered":"2024-09-13T18:08:00.056573+0000","last_clean":"2024-09-13T18:08:00.056573+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:08:00.056573+0000","last_undegraded":"2024-09-13T18:08:00.056573+0000","last_fullsized":"2024-09-13T18:08:00.056573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229461+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:09:20.229461+0000","last_peered":"2024-09-13T18:09:20.229461+0000","last_clean":"2024-09-13T18:09:20.229461+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:20.229461+0000","last_undegraded":"2024-09-13T18:09:20.229461+0000","last_fullsized":"2024-09-13T18:09:20.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.716994+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:06:16.716994+0000","last_peered":"2024-09-13T18:06:16.716994+0000","last_clean":"2024-09-13T18:06:16.716994+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:06:16.716994+0000","last_undegraded":"2024-09-13T18:06:16.716994+0000","last_fullsized":"2024-09-13T18:06:16.716994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.713078+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:06:16.713078+0000","last_peered":"2024-09-13T18:06:16.713078+0000","last_clean":"2024-09-13T18:06:16.713078+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:06:16.713078+0000","last_undegraded":"2024-09-13T18:06:16.713078+0000","last_fullsized":"2024-09-13T18:06:16.713078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233805+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:09:20.233805+0000","last_peered":"2024-09-13T18:09:20.233805+0000","last_clean":"2024-09-13T18:09:20.233805+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:20.233805+0000","last_undegraded":"2024-09-13T18:09:20.233805+0000","last_fullsized":"2024-09-13T18:09:20.233805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222469+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:06:17.222469+0000","last_peered":"2024-09-13T18:06:17.222469+0000","last_clean":"2024-09-13T18:06:17.222469+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:06:17.222469+0000","last_undegraded":"2024-09-13T18:06:17.222469+0000","last_fullsized":"2024-09-13T18:06:17.222469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231469+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:09:20.231469+0000","last_peered":"2024-09-13T18:09:20.231469+0000","last_clean":"2024-09-13T18:09:20.231469+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:20.231469+0000","last_undegraded":"2024-09-13T18:09:20.231469+0000","last_fullsized":"2024-09-13T18:09:20.231469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:55.052228+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:07:55.052228+0000","last_peered":"2024-09-13T18:07:55.052228+0000","last_clean":"2024-09-13T18:07:55.052228+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:07:55.052228+0000","last_undegraded":"2024-09-13T18:07:55.052228+0000","last_fullsized":"2024-09-13T18:07:55.052228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246708+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:09:20.246708+0000","last_peered":"2024-09-13T18:09:20.246708+0000","last_clean":"2024-09-13T18:09:20.246708+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:20.246708+0000","last_undegraded":"2024-09-13T18:09:20.246708+0000","last_fullsized":"2024-09-13T18:09:20.246708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223568+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:06:17.223568+0000","last_peered":"2024-09-13T18:06:17.223568+0000","last_clean":"2024-09-13T18:06:17.223568+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:06:17.223568+0000","last_undegraded":"2024-09-13T18:06:17.223568+0000","last_fullsized":"2024-09-13T18:06:17.223568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241669+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:09:20.241669+0000","last_peered":"2024-09-13T18:09:20.241669+0000","last_clean":"2024-09-13T18:09:20.241669+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:20.241669+0000","last_undegraded":"2024-09-13T18:09:20.241669+0000","last_fullsized":"2024-09-13T18:09:20.241669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":24,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:14.720977+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:09:14.720977+0000","last_peered":"2024-09-13T18:09:14.720977+0000","last_clean":"2024-09-13T18:09:14.720977+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:14.720977+0000","last_undegraded":"2024-09-13T18:09:14.720977+0000","last_fullsized":"2024-09-13T18:09:14.720977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236337+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:09:20.236337+0000","last_peered":"2024-09-13T18:09:20.236337+0000","last_clean":"2024-09-13T18:09:20.236337+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:20.236337+0000","last_undegraded":"2024-09-13T18:09:20.236337+0000","last_fullsized":"2024-09-13T18:09:20.236337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'95","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.249817+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:09:20.249817+0000","last_peered":"2024-09-13T18:09:20.249817+0000","last_clean":"2024-09-13T18:09:20.249817+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:20.249817+0000","last_undegraded":"2024-09-13T18:09:20.249817+0000","last_fullsized":"2024-09-13T18:09:20.249817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231850+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:09:20.231850+0000","last_peered":"2024-09-13T18:09:20.231850+0000","last_clean":"2024-09-13T18:09:20.231850+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:09:20.231850+0000","last_undegraded":"2024-09-13T18:09:20.231850+0000","last_fullsized":"2024-09-13T18:09:20.231850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223524+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:06:17.223524+0000","last_peered":"2024-09-13T18:06:17.223524+0000","last_clean":"2024-09-13T18:06:17.223524+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:06:17.223524+0000","last_undegraded":"2024-09-13T18:06:17.223524+0000","last_fullsized":"2024-09-13T18:06:17.223524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.226414+0000","last_change":"2024-09-13T18:06:17.149866+0000","last_active":"2024-09-13T18:09:20.226414+0000","last_peered":"2024-09-13T18:09:20.226414+0000","last_clean":"2024-09-13T18:09:20.226414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:20.226414+0000","last_undegraded":"2024-09-13T18:09:20.226414+0000","last_fullsized":"2024-09-13T18:09:20.226414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:10.096089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223854+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:06:17.223854+0000","last_peered":"2024-09-13T18:06:17.223854+0000","last_clean":"2024-09-13T18:06:17.223854+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:06:17.223854+0000","last_undegraded":"2024-09-13T18:06:17.223854+0000","last_fullsized":"2024-09-13T18:06:17.223854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239477+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:09:20.239477+0000","last_peered":"2024-09-13T18:09:20.239477+0000","last_clean":"2024-09-13T18:09:20.239477+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:20.239477+0000","last_undegraded":"2024-09-13T18:09:20.239477+0000","last_fullsized":"2024-09-13T18:09:20.239477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.717003+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:06:16.717003+0000","last_peered":"2024-09-13T18:06:16.717003+0000","last_clean":"2024-09-13T18:06:16.717003+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:06:16.717003+0000","last_undegraded":"2024-09-13T18:06:16.717003+0000","last_fullsized":"2024-09-13T18:06:16.717003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221064+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:09:20.221064+0000","last_peered":"2024-09-13T18:09:20.221064+0000","last_clean":"2024-09-13T18:09:20.221064+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:20.221064+0000","last_undegraded":"2024-09-13T18:09:20.221064+0000","last_fullsized":"2024-09-13T18:09:20.221064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'16","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:46.050658+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:07:46.050658+0000","last_peered":"2024-09-13T18:07:46.050658+0000","last_clean":"2024-09-13T18:07:46.050658+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:07:46.050658+0000","last_undegraded":"2024-09-13T18:07:46.050658+0000","last_fullsized":"2024-09-13T18:07:46.050658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232146+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:09:20.232146+0000","last_peered":"2024-09-13T18:09:20.232146+0000","last_clean":"2024-09-13T18:09:20.232146+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:20.232146+0000","last_undegraded":"2024-09-13T18:09:20.232146+0000","last_fullsized":"2024-09-13T18:09:20.232146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.225545+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:06:17.225545+0000","last_peered":"2024-09-13T18:06:17.225545+0000","last_clean":"2024-09-13T18:06:17.225545+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:06:17.225545+0000","last_undegraded":"2024-09-13T18:06:17.225545+0000","last_fullsized":"2024-09-13T18:06:17.225545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231559+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:09:20.231559+0000","last_peered":"2024-09-13T18:09:20.231559+0000","last_clean":"2024-09-13T18:09:20.231559+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:20.231559+0000","last_undegraded":"2024-09-13T18:09:20.231559+0000","last_fullsized":"2024-09-13T18:09:20.231559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714515+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:06:16.714515+0000","last_peered":"2024-09-13T18:06:16.714515+0000","last_clean":"2024-09-13T18:06:16.714515+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:06:16.714515+0000","last_undegraded":"2024-09-13T18:06:16.714515+0000","last_fullsized":"2024-09-13T18:06:16.714515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247445+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:09:20.247445+0000","last_peered":"2024-09-13T18:09:20.247445+0000","last_clean":"2024-09-13T18:09:20.247445+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:20.247445+0000","last_undegraded":"2024-09-13T18:09:20.247445+0000","last_fullsized":"2024-09-13T18:09:20.247445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.750024+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:06:16.750024+0000","last_peered":"2024-09-13T18:06:16.750024+0000","last_clean":"2024-09-13T18:06:16.750024+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:06:16.750024+0000","last_undegraded":"2024-09-13T18:06:16.750024+0000","last_fullsized":"2024-09-13T18:06:16.750024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222327+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:20.222327+0000","last_peered":"2024-09-13T18:09:20.222327+0000","last_clean":"2024-09-13T18:09:20.222327+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:20.222327+0000","last_undegraded":"2024-09-13T18:09:20.222327+0000","last_fullsized":"2024-09-13T18:09:20.222327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714215+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:06:16.714215+0000","last_peered":"2024-09-13T18:06:16.714215+0000","last_clean":"2024-09-13T18:06:16.714215+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:06:16.714215+0000","last_undegraded":"2024-09-13T18:06:16.714215+0000","last_fullsized":"2024-09-13T18:06:16.714215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240140+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:09:20.240140+0000","last_peered":"2024-09-13T18:09:20.240140+0000","last_clean":"2024-09-13T18:09:20.240140+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:20.240140+0000","last_undegraded":"2024-09-13T18:09:20.240140+0000","last_fullsized":"2024-09-13T18:09:20.240140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:20.054603+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:07:20.054603+0000","last_peered":"2024-09-13T18:07:20.054603+0000","last_clean":"2024-09-13T18:07:20.054603+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:07:20.054603+0000","last_undegraded":"2024-09-13T18:07:20.054603+0000","last_fullsized":"2024-09-13T18:07:20.054603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222824+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:06:17.222824+0000","last_peered":"2024-09-13T18:06:17.222824+0000","last_clean":"2024-09-13T18:06:17.222824+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:06:17.222824+0000","last_undegraded":"2024-09-13T18:06:17.222824+0000","last_fullsized":"2024-09-13T18:06:17.222824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239918+0000","last_change":"2024-09-13T18:06:17.227202+0000","last_active":"2024-09-13T18:09:20.239918+0000","last_peered":"2024-09-13T18:09:20.239918+0000","last_clean":"2024-09-13T18:09:20.239918+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:20.239918+0000","last_undegraded":"2024-09-13T18:09:20.239918+0000","last_fullsized":"2024-09-13T18:09:20.239918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:50:12.726841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146386+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:06:17.146386+0000","last_peered":"2024-09-13T18:06:17.146386+0000","last_clean":"2024-09-13T18:06:17.146386+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:06:17.146386+0000","last_undegraded":"2024-09-13T18:06:17.146386+0000","last_fullsized":"2024-09-13T18:06:17.146386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229227+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:09:20.229227+0000","last_peered":"2024-09-13T18:09:20.229227+0000","last_clean":"2024-09-13T18:09:20.229227+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:20.229227+0000","last_undegraded":"2024-09-13T18:09:20.229227+0000","last_fullsized":"2024-09-13T18:09:20.229227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.707089+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:09:18.707089+0000","last_peered":"2024-09-13T18:09:18.707089+0000","last_clean":"2024-09-13T18:09:18.707089+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:18.707089+0000","last_undegraded":"2024-09-13T18:09:18.707089+0000","last_fullsized":"2024-09-13T18:09:18.707089+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.218962+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:09:20.218962+0000","last_peered":"2024-09-13T18:09:20.218962+0000","last_clean":"2024-09-13T18:09:20.218962+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:20.218962+0000","last_undegraded":"2024-09-13T18:09:20.218962+0000","last_fullsized":"2024-09-13T18:09:20.218962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223846+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:06:17.223846+0000","last_peered":"2024-09-13T18:06:17.223846+0000","last_clean":"2024-09-13T18:06:17.223846+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:06:17.223846+0000","last_undegraded":"2024-09-13T18:06:17.223846+0000","last_fullsized":"2024-09-13T18:06:17.223846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227385+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:09:20.227385+0000","last_peered":"2024-09-13T18:09:20.227385+0000","last_clean":"2024-09-13T18:09:20.227385+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:20.227385+0000","last_undegraded":"2024-09-13T18:09:20.227385+0000","last_fullsized":"2024-09-13T18:09:20.227385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749841+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:06:16.749841+0000","last_peered":"2024-09-13T18:06:16.749841+0000","last_clean":"2024-09-13T18:06:16.749841+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:06:16.749841+0000","last_undegraded":"2024-09-13T18:06:16.749841+0000","last_fullsized":"2024-09-13T18:06:16.749841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240024+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:09:20.240024+0000","last_peered":"2024-09-13T18:09:20.240024+0000","last_clean":"2024-09-13T18:09:20.240024+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:20.240024+0000","last_undegraded":"2024-09-13T18:09:20.240024+0000","last_fullsized":"2024-09-13T18:09:20.240024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.147552+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:06:17.147552+0000","last_peered":"2024-09-13T18:06:17.147552+0000","last_clean":"2024-09-13T18:06:17.147552+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:06:17.147552+0000","last_undegraded":"2024-09-13T18:06:17.147552+0000","last_fullsized":"2024-09-13T18:06:17.147552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.219097+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:09:20.219097+0000","last_peered":"2024-09-13T18:09:20.219097+0000","last_clean":"2024-09-13T18:09:20.219097+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:20.219097+0000","last_undegraded":"2024-09-13T18:09:20.219097+0000","last_fullsized":"2024-09-13T18:09:20.219097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:16.510128+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:09:16.510128+0000","last_peered":"2024-09-13T18:09:16.510128+0000","last_clean":"2024-09-13T18:09:16.510128+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:16.510128+0000","last_undegraded":"2024-09-13T18:09:16.510128+0000","last_fullsized":"2024-09-13T18:09:16.510128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240595+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:09:20.240595+0000","last_peered":"2024-09-13T18:09:20.240595+0000","last_clean":"2024-09-13T18:09:20.240595+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:20.240595+0000","last_undegraded":"2024-09-13T18:09:20.240595+0000","last_fullsized":"2024-09-13T18:09:20.240595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:40.049606+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:07:40.049606+0000","last_peered":"2024-09-13T18:07:40.049606+0000","last_clean":"2024-09-13T18:07:40.049606+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:07:40.049606+0000","last_undegraded":"2024-09-13T18:07:40.049606+0000","last_fullsized":"2024-09-13T18:07:40.049606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221838+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:09:20.221838+0000","last_peered":"2024-09-13T18:09:20.221838+0000","last_clean":"2024-09-13T18:09:20.221838+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:20.221838+0000","last_undegraded":"2024-09-13T18:09:20.221838+0000","last_fullsized":"2024-09-13T18:09:20.221838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146357+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:06:17.146357+0000","last_peered":"2024-09-13T18:06:17.146357+0000","last_clean":"2024-09-13T18:06:17.146357+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:06:17.146357+0000","last_undegraded":"2024-09-13T18:06:17.146357+0000","last_fullsized":"2024-09-13T18:06:17.146357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.196059+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:09:20.196059+0000","last_peered":"2024-09-13T18:09:20.196059+0000","last_clean":"2024-09-13T18:09:20.196059+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:20.196059+0000","last_undegraded":"2024-09-13T18:09:20.196059+0000","last_fullsized":"2024-09-13T18:09:20.196059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749639+0000","last_change":"2024-09-13T18:05:26.119815+0000","last_active":"2024-09-13T18:06:16.749639+0000","last_peered":"2024-09-13T18:06:16.749639+0000","last_clean":"2024-09-13T18:06:16.749639+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:06:16.749639+0000","last_undegraded":"2024-09-13T18:06:16.749639+0000","last_fullsized":"2024-09-13T18:06:16.749639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232322+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:09:20.232322+0000","last_peered":"2024-09-13T18:09:20.232322+0000","last_clean":"2024-09-13T18:09:20.232322+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:20.232322+0000","last_undegraded":"2024-09-13T18:09:20.232322+0000","last_fullsized":"2024-09-13T18:09:20.232322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.749649+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:06:16.749649+0000","last_peered":"2024-09-13T18:06:16.749649+0000","last_clean":"2024-09-13T18:06:16.749649+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:06:16.749649+0000","last_undegraded":"2024-09-13T18:06:16.749649+0000","last_fullsized":"2024-09-13T18:06:16.749649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236736+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:09:20.236736+0000","last_peered":"2024-09-13T18:09:20.236736+0000","last_clean":"2024-09-13T18:09:20.236736+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:20.236736+0000","last_undegraded":"2024-09-13T18:09:20.236736+0000","last_fullsized":"2024-09-13T18:09:20.236736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:45.060694+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:07:45.060694+0000","last_peered":"2024-09-13T18:07:45.060694+0000","last_clean":"2024-09-13T18:07:45.060694+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:07:45.060694+0000","last_undegraded":"2024-09-13T18:07:45.060694+0000","last_fullsized":"2024-09-13T18:07:45.060694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":141,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228017+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:09:20.228017+0000","last_peered":"2024-09-13T18:09:20.228017+0000","last_clean":"2024-09-13T18:09:20.228017+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:20.228017+0000","last_undegraded":"2024-09-13T18:09:20.228017+0000","last_fullsized":"2024-09-13T18:09:20.228017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245337+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:09:20.245337+0000","last_peered":"2024-09-13T18:09:20.245337+0000","last_clean":"2024-09-13T18:09:20.245337+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:09:20.245337+0000","last_undegraded":"2024-09-13T18:09:20.245337+0000","last_fullsized":"2024-09-13T18:09:20.245337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146813+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:06:17.146813+0000","last_peered":"2024-09-13T18:06:17.146813+0000","last_clean":"2024-09-13T18:06:17.146813+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:06:17.146813+0000","last_undegraded":"2024-09-13T18:06:17.146813+0000","last_fullsized":"2024-09-13T18:06:17.146813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245976+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.245976+0000","last_peered":"2024-09-13T18:09:20.245976+0000","last_clean":"2024-09-13T18:09:20.245976+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.245976+0000","last_undegraded":"2024-09-13T18:09:20.245976+0000","last_fullsized":"2024-09-13T18:09:20.245976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:53.633949+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:07:53.633949+0000","last_peered":"2024-09-13T18:07:53.633949+0000","last_clean":"2024-09-13T18:07:53.633949+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:07:53.633949+0000","last_undegraded":"2024-09-13T18:07:53.633949+0000","last_fullsized":"2024-09-13T18:07:53.633949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241744+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:09:20.241744+0000","last_peered":"2024-09-13T18:09:20.241744+0000","last_clean":"2024-09-13T18:09:20.241744+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:20.241744+0000","last_undegraded":"2024-09-13T18:09:20.241744+0000","last_fullsized":"2024-09-13T18:09:20.241744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.714885+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:06:16.714885+0000","last_peered":"2024-09-13T18:06:16.714885+0000","last_clean":"2024-09-13T18:06:16.714885+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:06:16.714885+0000","last_undegraded":"2024-09-13T18:06:16.714885+0000","last_fullsized":"2024-09-13T18:06:16.714885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233883+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:09:20.233883+0000","last_peered":"2024-09-13T18:09:20.233883+0000","last_clean":"2024-09-13T18:09:20.233883+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:20.233883+0000","last_undegraded":"2024-09-13T18:09:20.233883+0000","last_fullsized":"2024-09-13T18:09:20.233883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223509+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:06:17.223509+0000","last_peered":"2024-09-13T18:06:17.223509+0000","last_clean":"2024-09-13T18:06:17.223509+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:06:17.223509+0000","last_undegraded":"2024-09-13T18:06:17.223509+0000","last_fullsized":"2024-09-13T18:06:17.223509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.65800000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.99099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.73999999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.139,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1120000000000001,"5min":1.516,"15min":1.516},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.499},"max":{"1min":3.7919999999999998,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.96699999999999997,"15min":1.0129999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2330000000000001,"5min":1.907,"15min":1.907},"last":1.03},{"interface":"front","average":{"1min":1.135,"5min":1.048,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.998,"15min":1.077},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4279999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.024,"15min":1.05},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.4539999999999997,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":1.0980000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.66200000000000003},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.73999999999999999,"5min":2.077,"15min":2.077},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":11.384,"5min":11.384,"15min":11.384},"last":0.68400000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.749},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.71999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4590000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.93799999999999994,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.181,"5min":1.347,"15min":1.347},"last":0.94999999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.319,"5min":1.452,"15min":1.452},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.88900000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.006,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1990000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.222,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.91400000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.377,"5min":1.46,"15min":1.46},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.93400000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.77100000000000002},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.232},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.96099999999999997,"15min":1.054},"min":{"1min":0.50800000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.159,"5min":6.093,"15min":6.093},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":1.079,"15min":1.169},"min":{"1min":0.59799999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2849999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.86299999999999999,"15min":0.90500000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1259999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.81899999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.81100000000000005,"15min":0.82899999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.629},{"interface":"front","average":{"1min":0.86599999999999999,"5min":1.0649999999999999,"15min":1.165},"min":{"1min":0.59399999999999997,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.377,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.92000000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82599999999999996,"15min":0.82999999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.93500000000000005,"15min":0.96499999999999997},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3200000000000001,"5min":1.363,"15min":1.363},"last":1.105}]},{"osd":4,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.97199999999999998,"15min":0.98599999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93300000000000005,"5min":1.177,"15min":1.278},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.45,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.032}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.169,"15min":1.2569999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.772,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":1.204,"15min":1.294},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.411,"5min":5.2759999999999998,"15min":5.2759999999999998},"last":1.1910000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.347,"15min":1.4630000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0059999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.1339999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.145,"15min":1.2190000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.274,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.95199999999999996}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.92500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.77600000000000002,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.198,"5min":1.222,"15min":1.222},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.78700000000000003},"min":{"1min":0.50700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":1.0840000000000001,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.98599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84299999999999997,"15min":0.84999999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.23,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.90400000000000003,"15min":0.95199999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.099},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2789999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5329999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.026},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0589999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.75700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.048,"5min":1.097,"15min":1.1259999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.552,"5min":1.621,"15min":1.621},"last":1.143}]}]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78200000000000003,"15min":0.80000000000000004},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.3700000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.86099999999999999,"15min":0.89200000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":2.8159999999999998,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.90700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.747},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.878,"15min":0.90700000000000003},"min":{"1min":0.44500000000000001,"5min":0.443,"15min":0.443},"max":{"1min":2.6899999999999999,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.96199999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":0.93400000000000005,"15min":0.96199999999999997},"min":{"1min":0.51800000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.85099999999999998,"15min":0.876},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0880000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0840000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.0009999999999999,"15min":1.0069999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.2890000000000001,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96199999999999997,"15min":0.98399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":3.125,"5min":3.125,"15min":3.125},"last":0.998}]},{"osd":5,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.97999999999999998,"15min":1.024},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.6799999999999999,"5min":1.909,"15min":1.909},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.113,"5min":1.089,"15min":1.1180000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.6179999999999999,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.0149999999999999,"15min":1.0529999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.2589999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5169999999999999,"5min":1.885,"15min":1.885},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:24 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.123,"15min":1.1619999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.5600000000000001,"5min":1.647,"15min":1.647},"last":1.024},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.123,"15min":1.181},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3220000000000001,"5min":1.851,"15min":1.851},"last":0.93999999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.745},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.27600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.105}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.75700000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.99299999999999999,"5min":1.798,"15min":1.798},"last":0.82799999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.88600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":1.0089999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":0.97199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0669999999999999,"5min":1.905,"15min":1.905},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.95499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":1}]},{"osd":6,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0609999999999999,"15min":1.0880000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.216},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0609999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.974,"15min":1.974},"last":1.319}]},{"osd":7,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.008,"15min":1.04},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3799999999999999,"5min":1.444,"15min":1.444},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.083,"15min":1.095},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.3420000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.077}]},{"osd":1,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.875},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.90400000000000003,"15min":0.95399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.121,"5min":1.173,"15min":1.173},"last":1.167}]},{"osd":2,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0720000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":1.2090000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":1.097},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.97699999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.042},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":0.997}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57899999999999996},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88,"5min":1.214,"15min":1.214},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.64400000000000002},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.76800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.054,"5min":2.27,"15min":2.27},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.752,"15min":0.79400000000000004},"min":{"1min":0.32100000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.542,"5min":2.306,"15min":2.306},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.79400000000000004},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.012,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.68600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.93200000000000005,"15min":0.96999999999999997},"min":{"1min":0.55300000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1859999999999999,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.95299999999999996,"15min":0.95899999999999996},"min":{"1min":0.56299999999999994,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.8300000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.0349999999999999,"15min":1.036},"min":{"1min":0.60399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0249999999999999,"15min":1.0649999999999999},"min":{"1min":0.57899999999999996,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.268,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.04}]},{"osd":6,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.0549999999999999,"15min":1.1020000000000001},"min":{"1min":0.63,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.7270000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.081},{"interface":"front","average":{"1min":1.032,"5min":1.0680000000000001,"15min":1.1060000000000001},"min":{"1min":0.66000000000000003,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.254,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.86599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:08:22 2024","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":1.03,"15min":1.0820000000000001},"min":{"1min":0.59099999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.8759999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.056,"5min":1.133,"15min":1.1819999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.851,"5min":3.2599999999999998,"15min":3.2599999999999998},"last":1.1679999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:09:27.613 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:09:27.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.723+0000 7fc393fff700 1 Processor -- start 2024-09-13T18:09:27.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.723+0000 7fc393fff700 1 -- start start 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc39414fdb0 0x7fc394159100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc394156530 0x7fc3940c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3940c18f0 con 0x7fc394071720 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3941560a0 con 0x7fc39414fdb0 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc394159fe0 con 0x7fc394156530 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc39414fdb0 0x7fc394159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc3937fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc394071720 0x7fc3940c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36070/0 (socket says 172.21.15.88:36070) 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc3937fe700 1 -- 172.21.15.88:0/452585066 learned_addr learned my addr 172.21.15.88:0/452585066 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:27.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc38a7fc700 1 --2- 172.21.15.88:0/452585066 >> v2:172.21.15.94:3300/0 conn(0x7fc394156530 0x7fc3940c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 -- 172.21.15.88:0/452585066 >> v2:172.21.15.94:3300/0 conn(0x7fc394156530 msgr2=0x7fc3940c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 --2- 172.21.15.88:0/452585066 >> v2:172.21.15.94:3300/0 conn(0x7fc394156530 0x7fc3940c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 -- 172.21.15.88:0/452585066 >> v1:172.21.15.88:6789/0 conn(0x7fc394071720 legacy=0x7fc3940c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 -- 172.21.15.88:0/452585066 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394159740 con 0x7fc39414fdb0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc392ffd700 1 --2- 172.21.15.88:0/452585066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc39414fdb0 0x7fc394159100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3940723b0 tx=0x7fc384009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40615f1070066b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc3927fc700 1 -- 172.21.15.88:0/452585066 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384011830 con 0x7fc39414fdb0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc3927fc700 1 -- 172.21.15.88:0/452585066 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc384011990 con 0x7fc39414fdb0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc3927fc700 1 -- 172.21.15.88:0/452585066 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc384011d20 con 0x7fc39414fdb0 2024-09-13T18:09:27.734 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- 172.21.15.88:0/452585066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc39414fdb0 msgr2=0x7fc394159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 --2- 172.21.15.88:0/452585066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc39414fdb0 0x7fc394159100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3940723b0 tx=0x7fc384009b30 comp rx=0 tx=0).stop 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- 172.21.15.88:0/452585066 shutdown_connections 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 --2- 172.21.15.88:0/452585066 >> v2:172.21.15.94:3300/0 conn(0x7fc394156530 0x7fc3940c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 --2- 172.21.15.88:0/452585066 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc39414fdb0 0x7fc394159100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- 172.21.15.88:0/452585066 >> 172.21.15.88:0/452585066 conn(0x7fc3940ca720 msgr2=0x7fc3940cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- 172.21.15.88:0/452585066 shutdown_connections 2024-09-13T18:09:27.735 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- 172.21.15.88:0/452585066 wait complete. 2024-09-13T18:09:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 Processor -- start 2024-09-13T18:09:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.727+0000 7fc393fff700 1 -- start start 2024-09-13T18:09:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc394071720 0x7fc3940c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.737 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc39414fdb0 0x7fc394154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940b93b0 con 0x7fc394156530 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940c3c10 con 0x7fc394071720 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940c4630 con 0x7fc39414fdb0 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59698/0 (socket says 172.21.15.88:59698) 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 -- 172.21.15.88:0/1750505144 learned_addr learned my addr 172.21.15.88:0/1750505144 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc38a7fc700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc39414fdb0 0x7fc394154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc392ffd700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc394071720 0x7fc3940c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 -- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc39414fdb0 msgr2=0x7fc394154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc39414fdb0 0x7fc394154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 -- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc394071720 msgr2=0x7fc3940c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc394071720 0x7fc3940c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.738 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 -- 172.21.15.88:0/1750505144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3840094b0 con 0x7fc394156530 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc3937fe700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00cbc0 tx=0x7fc38c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c007480 con 0x7fc394156530 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c0075e0 con 0x7fc394156530 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940c3000 con 0x7fc394156530 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c007950 con 0x7fc394156530 2024-09-13T18:09:27.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3940c35c0 con 0x7fc394156530 2024-09-13T18:09:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.731+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3941ef930 con 0x7fc394156530 2024-09-13T18:09:27.740 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.735+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc38c012400 con 0x7fc394156530 2024-09-13T18:09:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.735+0000 7fc38bfff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 0x7fc374068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.735+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc38c083a90 con 0x7fc394156530 2024-09-13T18:09:27.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.735+0000 7fc392ffd700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 0x7fc374068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:27.742 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.735+0000 7fc392ffd700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 0x7fc374068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:27.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.743+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc38c050e30 con 0x7fc394156530 2024-09-13T18:09:27.923 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.919+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc394157000 con 0x7fc394156530 2024-09-13T18:09:27.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.919+0000 7fc38bfff700 1 -- 172.21.15.88:0/1750505144 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fc38c017020 con 0x7fc394156530 2024-09-13T18:09:27.927 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:27.927 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:06:16.706465+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 msgr2=0x7fc374068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 0x7fc374068bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc384000c00 tx=0x7fc384008030 comp rx=0 tx=0).stop 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 msgr2=0x7fc3941efc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc38c00cbc0 tx=0x7fc38c00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 shutdown_connections 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc374066730 0x7fc374068bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.929 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc39414fdb0 0x7fc394154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc394156530 0x7fc3941efc10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 --2- 172.21.15.88:0/1750505144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc394071720 0x7fc3940c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:27.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 >> 172.21.15.88:0/1750505144 conn(0x7fc3940ca720 msgr2=0x7fc39414e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:27.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 shutdown_connections 2024-09-13T18:09:27.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:27.923+0000 7fc393fff700 1 -- 172.21.15.88:0/1750505144 wait complete. 2024-09-13T18:09:28.943 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:09:28.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:29.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 Processor -- start 2024-09-13T18:09:29.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 -- start start 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f119406e500 0x7f1194159e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940c1c50 con 0x7f11940c0b60 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940c2180 con 0x7f119406e8e0 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.071+0000 7f119c102700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940c1ea0 con 0x7f119406e500 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f11940c0b60 0x7f11940bfff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36082/0 (socket says 172.21.15.88:36082) 2024-09-13T18:09:29.079 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 -- 172.21.15.88:0/2098426437 learned_addr learned my addr 172.21.15.88:0/2098426437 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1199e9e700 1 --2- 172.21.15.88:0/2098426437 >> v2:172.21.15.94:3300/0 conn(0x7f119406e500 0x7f1194159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959585787 0 0) 0x7f11940c1c50 con 0x7f11940c0b60 2024-09-13T18:09:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11800035d0 con 0x7f11940c0b60 2024-09-13T18:09:29.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 5174917 0 0) 0x7f11800035d0 con 0x7f11940c0b60 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 >> v2:172.21.15.94:3300/0 conn(0x7f119406e500 msgr2=0x7f1194159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 --2- 172.21.15.88:0/2098426437 >> v2:172.21.15.94:3300/0 conn(0x7f119406e500 0x7f1194159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 >> v1:172.21.15.94:6789/0 conn(0x7f119406e8e0 legacy=0x7f1194163b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1194159350 con 0x7f11940c0b60 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7f1190001670 con 0x7f11940c0b60 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 >> v1:172.21.15.88:6789/0 conn(0x7f11940c0b60 legacy=0x7f11940bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180003a20 0x7f1180003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 0x7f1180004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1180005230 0x7f118000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940c1ea0 con 0x7f1180004870 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118000c0d0 con 0x7f1180005230 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118000c290 con 0x7f1180003a20 2024-09-13T18:09:29.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 0x7f1180004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1199e9e700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180003a20 0x7f1180003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119a69f700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1180005230 0x7f118000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 -- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180003a20 msgr2=0x7f1180003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180003a20 0x7f1180003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 -- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1180005230 msgr2=0x7f118000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1180005230 0x7f118000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119a69f700 1 -- 172.21.15.88:0/2098426437 reap_dead start 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 -- 172.21.15.88:0/2098426437 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800035d0 con 0x7f1180004870 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119969d700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 0x7f1180004cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f119000c2a0 tx=0x7f11800058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6688dcba2c84ad2f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190007c30 con 0x7f1180004870 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000ce00 con 0x7f1180004870 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f1198e9c700 1 -- 172.21.15.88:0/2098426437 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190005bc0 con 0x7f1180004870 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 -- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 msgr2=0x7f1180004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 0x7f1180004cf0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f119000c2a0 tx=0x7f11800058a0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 -- 172.21.15.88:0/2098426437 shutdown_connections 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 --2- 172.21.15.88:0/2098426437 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1180004870 0x7f1180004cf0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 -- 172.21.15.88:0/2098426437 >> 172.21.15.88:0/2098426437 conn(0x7f119406a300 msgr2=0x7f11940cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 -- 172.21.15.88:0/2098426437 shutdown_connections 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.075+0000 7f119c102700 1 -- 172.21.15.88:0/2098426437 wait complete. 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.079+0000 7f119c102700 1 Processor -- start 2024-09-13T18:09:29.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.079+0000 7f119c102700 1 -- start start 2024-09-13T18:09:29.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 0x7f11941f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f119414def0 0x7f119415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f119415a5e0 0x7f119415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11941f2ee0 con 0x7f119415a5e0 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119414f2b0 con 0x7f119414def0 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119414f590 con 0x7f1180004870 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 0x7f11941f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 0x7f11941f25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:58216/0 (socket says 172.21.15.88:58216) 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119a69f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f119415a5e0 0x7f119415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 -- 172.21.15.88:0/1118302015 learned_addr learned my addr 172.21.15.88:0/1118302015 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119969d700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f119414def0 0x7f119415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 -- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f119414def0 msgr2=0x7f119415b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f119414def0 0x7f119415b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 -- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f119415a5e0 msgr2=0x7f119415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f119415a5e0 0x7f119415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119415aff0 con 0x7f1180004870 2024-09-13T18:09:29.089 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119a69f700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f119415a5e0 0x7f119415bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:29.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f1199e9e700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 0x7f11941f25b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11840115d0 tx=0x7f11840118e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184015870 con 0x7f1180004870 2024-09-13T18:09:29.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11840159d0 con 0x7f1180004870 2024-09-13T18:09:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119415b2d0 con 0x7f1180004870 2024-09-13T18:09:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1184015d40 con 0x7f1180004870 2024-09-13T18:09:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1194152fc0 con 0x7f1180004870 2024-09-13T18:09:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.083+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1194159910 con 0x7f1180004870 2024-09-13T18:09:29.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1184027420 con 0x7f1180004870 2024-09-13T18:09:29.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1178066730 0x7f1178068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1184084800 con 0x7f1180004870 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7f117806ea50 0x7f1178070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f11780715a0 con 0x7f117806ea50 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1184084c50 con 0x7f1180004870 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f119969d700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1178066730 0x7f1178068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f119a69f700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7f117806ea50 0x7f1178070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f119969d700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1178066730 0x7f1178068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1190000c00 tx=0x7f1190007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f119a69f700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7f117806ea50 0x7f1178070ed0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.087+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== osd.0 v2:172.21.15.88:6800/3777001302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f11780715a0 con 0x7f117806ea50 2024-09-13T18:09:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 --> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f119414f3f0 con 0x7f117806ea50 2024-09-13T18:09:29.112 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f118a7fc700 1 -- 172.21.15.88:0/1118302015 <== osd.0 v2:172.21.15.88:6800/3777001302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f119414f3f0 con 0x7f117806ea50 2024-09-13T18:09:29.113 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:29.113 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:29.113 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7f117806ea50 msgr2=0x7f1178070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.88:6800/3777001302,v1:172.21.15.88:6801/3777001302] conn(0x7f117806ea50 0x7f1178070ed0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1178066730 msgr2=0x7f1178068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1178066730 0x7f1178068bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1190000c00 tx=0x7f1190007000 comp rx=0 tx=0).stop 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 msgr2=0x7f11941f25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 --2- 172.21.15.88:0/1118302015 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1180004870 0x7f11941f25b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11840115d0 tx=0x7f11840118e0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119a69f700 1 -- 172.21.15.88:0/1118302015 reap_dead start 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 shutdown_connections 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 >> 172.21.15.88:0/1118302015 conn(0x7f119406a300 msgr2=0x7f11940cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 shutdown_connections 2024-09-13T18:09:29.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.107+0000 7f119c102700 1 -- 172.21.15.88:0/1118302015 wait complete. 2024-09-13T18:09:29.126 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:09:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 Processor -- start 2024-09-13T18:09:29.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 -- start start 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92700c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9270156e50 con 0x7f927015ad20 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92701570f0 con 0x7f92700c1e00 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92758f6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92701573d0 con 0x7f92700c21e0 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92750f5700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f927015ad20 0x7f9270150ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:36098/0 (socket says 172.21.15.88:36098) 2024-09-13T18:09:29.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f92750f5700 1 -- 172.21.15.88:0/3257470079 learned_addr learned my addr 172.21.15.88:0/3257470079 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926ffff700 1 --2- 172.21.15.88:0/3257470079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92700c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926f7fe700 1 -- 172.21.15.88:0/3257470079 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160586898 0 0) 0x7f9270156e50 con 0x7f927015ad20 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926f7fe700 1 -- 172.21.15.88:0/3257470079 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92580035d0 con 0x7f927015ad20 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926ffff700 1 -- 172.21.15.88:0/3257470079 >> v1:172.21.15.94:6789/0 conn(0x7f92700c1e00 legacy=0x7f927015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926ffff700 1 -- 172.21.15.88:0/3257470079 >> v1:172.21.15.88:6789/0 conn(0x7f927015ad20 legacy=0x7f9270150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.243+0000 7f926ffff700 1 -- 172.21.15.88:0/3257470079 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92701576b0 con 0x7f92700c21e0 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f926ffff700 1 --2- 172.21.15.88:0/3257470079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92700c47c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9260009dc0 tx=0x7f926000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a978434487323a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f926f7fe700 1 -- 172.21.15.88:0/3257470079 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926000e070 con 0x7f92700c21e0 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f926f7fe700 1 -- 172.21.15.88:0/3257470079 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926000bb20 con 0x7f92700c21e0 2024-09-13T18:09:29.252 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f926f7fe700 1 -- 172.21.15.88:0/3257470079 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926000be90 con 0x7f92700c21e0 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 -- 172.21.15.88:0/3257470079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 msgr2=0x7f92700c47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 --2- 172.21.15.88:0/3257470079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92700c47c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9260009dc0 tx=0x7f926000b330 comp rx=0 tx=0).stop 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 -- 172.21.15.88:0/3257470079 shutdown_connections 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 --2- 172.21.15.88:0/3257470079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92700c47c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 -- 172.21.15.88:0/3257470079 >> 172.21.15.88:0/3257470079 conn(0x7f92700664b0 msgr2=0x7f927006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 -- 172.21.15.88:0/3257470079 shutdown_connections 2024-09-13T18:09:29.253 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.247+0000 7f92758f6700 1 -- 172.21.15.88:0/3257470079 wait complete. 2024-09-13T18:09:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 Processor -- start 2024-09-13T18:09:29.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- start start 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92700c1e00 0x7f92701f02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92701e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92701ec360 con 0x7f927015ad20 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92701f0820 con 0x7f92700c1e00 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92701e0530 con 0x7f92700c21e0 2024-09-13T18:09:29.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59730/0 (socket says 172.21.15.88:59730) 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 -- 172.21.15.88:0/3037527800 learned_addr learned my addr 172.21.15.88:0/3037527800 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f926ffff700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92701e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92748f4700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92700c1e00 0x7f92701f02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 -- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 msgr2=0x7f92701e1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92701e1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 -- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92700c1e00 msgr2=0x7f92701f02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92700c1e00 0x7f92701f02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 -- 172.21.15.88:0/3037527800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9260009a70 con 0x7f927015ad20 2024-09-13T18:09:29.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92750f5700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f926800c4d0 tx=0x7f926800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268005d90 con 0x7f927015ad20 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800ce80 con 0x7f927015ad20 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92701e1f90 con 0x7f927015ad20 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92680072f0 con 0x7f927015ad20 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.251+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92701e0250 con 0x7f927015ad20 2024-09-13T18:09:29.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.255+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927006f660 con 0x7f927015ad20 2024-09-13T18:09:29.261 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.255+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f9268007450 con 0x7f927015ad20 2024-09-13T18:09:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.255+0000 7f926d7fa700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.255+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9268083530 con 0x7f927015ad20 2024-09-13T18:09:29.262 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.255+0000 7f92748f4700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.263 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.259+0000 7f92748f4700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92640018a0 tx=0x7f9264009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.270 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.263+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f9268050820 con 0x7f927015ad20 2024-09-13T18:09:29.441 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.435+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f92701555c0 con 0x7f925c066730 2024-09-13T18:09:29.442 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.435+0000 7f926d7fa700 1 -- 172.21.15.88:0/3037527800 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f92701555c0 con 0x7f925c066730 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 msgr2=0x7f925c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 0x7f925c068bf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f92640018a0 tx=0x7f9264009040 comp rx=0 tx=0).stop 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 msgr2=0x7f9270159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f926800c4d0 tx=0x7f926800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 shutdown_connections 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f925c066730 0x7f925c068bf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92700c21e0 0x7f92701e1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f927015ad20 0x7f9270159890 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.447 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 --2- 172.21.15.88:0/3037527800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92700c1e00 0x7f92701f02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 >> 172.21.15.88:0/3037527800 conn(0x7f92700664b0 msgr2=0x7f9270150890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 shutdown_connections 2024-09-13T18:09:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.439+0000 7f92758f6700 1 -- 172.21.15.88:0/3037527800 wait complete. 2024-09-13T18:09:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:09:29.463 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:09:29.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:29.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 Processor -- start 2024-09-13T18:09:29.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- start start 2024-09-13T18:09:29.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 0x7f32b006feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b0070c90 con 0x7f32b00c4940 2024-09-13T18:09:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b006d930 con 0x7f32b0151430 2024-09-13T18:09:29.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b006e840 con 0x7f32b006dea0 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32af7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 0x7f32b006feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:58236/0 (socket says 172.21.15.88:58236) 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32af7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 0x7f32b006feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:41960/0 (socket says 172.21.15.88:41960) 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 -- 172.21.15.88:0/3021231439 learned_addr learned my addr 172.21.15.88:0/3021231439 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 -- 172.21.15.88:0/3021231439 >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 msgr2=0x7f32b006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:29.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 --2- 172.21.15.88:0/3021231439 >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 0x7f32b006feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 -- 172.21.15.88:0/3021231439 >> v1:172.21.15.94:6789/0 conn(0x7f32b00c4940 legacy=0x7f32b006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 -- 172.21.15.88:0/3021231439 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b015afc0 con 0x7f32b006dea0 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32affff700 1 --2- 172.21.15.88:0/3021231439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e50 tx=0x7f32a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e95724480ac5164c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32ae7fc700 1 -- 172.21.15.88:0/3021231439 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800e070 con 0x7f32b006dea0 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32ae7fc700 1 -- 172.21.15.88:0/3021231439 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a800b910 con 0x7f32b006dea0 2024-09-13T18:09:29.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32ae7fc700 1 -- 172.21.15.88:0/3021231439 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a800bcc0 con 0x7f32b006dea0 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3021231439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 msgr2=0x7f32b006e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3021231439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f32a8009e50 tx=0x7f32a800b330 comp rx=0 tx=0).stop 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3021231439 shutdown_connections 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3021231439 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b006e300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3021231439 >> v2:172.21.15.94:3300/0 conn(0x7f32b0151430 0x7f32b006feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.575+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3021231439 >> 172.21.15.88:0/3021231439 conn(0x7f32b00c7320 msgr2=0x7f32b00c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3021231439 shutdown_connections 2024-09-13T18:09:29.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3021231439 wait complete. 2024-09-13T18:09:29.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 Processor -- start 2024-09-13T18:09:29.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- start start 2024-09-13T18:09:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 0x7f32b01f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32b0151430 0x7f32b01f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01e20f0 con 0x7f32b00c4940 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b0151bd0 con 0x7f32b0151430 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32b5cfd700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b01e2370 con 0x7f32b006dea0 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32aeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 0x7f32b01f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32aeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 0x7f32b01f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59738/0 (socket says 172.21.15.88:59738) 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32aeffd700 1 -- 172.21.15.88:0/3440529995 learned_addr learned my addr 172.21.15.88:0/3440529995 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32af7fe700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.579+0000 7f32affff700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32b0151430 0x7f32b01f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 -- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 msgr2=0x7f32b014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32b006dea0 0x7f32b014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 -- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32b0151430 msgr2=0x7f32b01f0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32b0151430 0x7f32b01f0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a8009b30 con 0x7f32b00c4940 2024-09-13T18:09:29.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32aeffd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 0x7f32b01f03f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c4d0 tx=0x7f32a400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40052d0 con 0x7f32b00c4940 2024-09-13T18:09:29.589 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a4005430 con 0x7f32b00c4940 2024-09-13T18:09:29.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b01e2650 con 0x7f32b00c4940 2024-09-13T18:09:29.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a40055a0 con 0x7f32b00c4940 2024-09-13T18:09:29.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b01e2c10 con 0x7f32b00c4940 2024-09-13T18:09:29.590 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32b015a690 con 0x7f32b00c4940 2024-09-13T18:09:29.591 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.583+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f32a40038c0 con 0x7f32b00c4940 2024-09-13T18:09:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f329c066730 0x7f329c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f32a40835a0 con 0x7f32b00c4940 2024-09-13T18:09:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7f329c06ea50 0x7f329c070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f329c0715a0 con 0x7f329c06ea50 2024-09-13T18:09:29.592 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f32af7fe700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f329c066730 0x7f329c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32a4085c00 con 0x7f32b00c4940 2024-09-13T18:09:29.596 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f32affff700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7f329c06ea50 0x7f329c070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f32affff700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7f329c06ea50 0x7f329c070ed0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f32af7fe700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f329c066730 0x7f329c068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b50 tx=0x7f32a0009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.597 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.587+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== osd.1 v2:172.21.15.88:6824/1509066892 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f329c0715a0 con 0x7f329c06ea50 2024-09-13T18:09:29.612 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 --> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f32b00703f0 con 0x7f329c06ea50 2024-09-13T18:09:29.613 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f3297fff700 1 -- 172.21.15.88:0/3440529995 <== osd.1 v2:172.21.15.88:6824/1509066892 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f32a800bc00 con 0x7f329c06ea50 2024-09-13T18:09:29.613 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:29.613 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:29.613 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:29.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7f329c06ea50 msgr2=0x7f329c070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:6824/1509066892,v1:172.21.15.88:6825/1509066892] conn(0x7f329c06ea50 0x7f329c070ed0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.614 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f329c066730 msgr2=0x7f329c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f329c066730 0x7f329c068bf0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009b50 tx=0x7f32a0009240 comp rx=0 tx=0).stop 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 msgr2=0x7f32b01f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 --2- 172.21.15.88:0/3440529995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f32b00c4940 0x7f32b01f03f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c4d0 tx=0x7f32a400c7e0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32affff700 1 -- 172.21.15.88:0/3440529995 reap_dead start 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 shutdown_connections 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 >> 172.21.15.88:0/3440529995 conn(0x7f32b00c7320 msgr2=0x7f32b006f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 shutdown_connections 2024-09-13T18:09:29.615 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.607+0000 7f32b5cfd700 1 -- 172.21.15.88:0/3440529995 wait complete. 2024-09-13T18:09:29.631 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:09:29.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 Processor -- start 2024-09-13T18:09:29.750 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 -- start start 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4ec0c21e0 0x7fe4ec15a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4ec156e50 con 0x7fe4ec06d890 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec1570f0 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.743+0000 7fe4eb59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1573d0 con 0x7fe4ec0c1e00 2024-09-13T18:09:29.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4ec0c21e0 0x7fe4ec15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe4ec0c21e0 0x7fe4ec15a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59746/0 (socket says 172.21.15.88:59746) 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 -- 172.21.15.88:0/2290818478 learned_addr learned my addr 172.21.15.88:0/2290818478 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4ea59c700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 -- 172.21.15.88:0/2290818478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 msgr2=0x7fe4ec0c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e959a700 1 -- 172.21.15.88:0/2290818478 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171936894 0 0) 0x7fe4ec156e50 con 0x7fe4ec06d890 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 -- 172.21.15.88:0/2290818478 >> v1:172.21.15.94:6789/0 conn(0x7fe4ec06d890 legacy=0x7fe4ec150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 -- 172.21.15.88:0/2290818478 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec1576b0 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e9d9b700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec15a610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2b9786a9243f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e959a700 1 -- 172.21.15.88:0/2290818478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00e070 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e959a700 1 -- 172.21.15.88:0/2290818478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4dc00b910 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4e959a700 1 -- 172.21.15.88:0/2290818478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4dc00bcc0 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 -- 172.21.15.88:0/2290818478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec0c21e0 msgr2=0x7fe4ec15a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec15a610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc00b330 comp rx=0 tx=0).stop 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 -- 172.21.15.88:0/2290818478 shutdown_connections 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec15a610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/2290818478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 -- 172.21.15.88:0/2290818478 >> 172.21.15.88:0/2290818478 conn(0x7fe4ec0664b0 msgr2=0x7fe4ec06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 -- 172.21.15.88:0/2290818478 shutdown_connections 2024-09-13T18:09:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.747+0000 7fe4eb59e700 1 -- 172.21.15.88:0/2290818478 wait complete. 2024-09-13T18:09:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 Processor -- start 2024-09-13T18:09:29.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- start start 2024-09-13T18:09:29.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec0c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec153a70 con 0x7fe4ec06d890 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c5820 con 0x7fe4ec0c21e0 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1ece90 con 0x7fe4ec0c1e00 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59758/0 (socket says 172.21.15.88:59758) 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 -- 172.21.15.88:0/1295947147 learned_addr learned my addr 172.21.15.88:0/1295947147 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4e9d9b700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.758 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ead9d700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec0c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 -- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 msgr2=0x7fe4ec0c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 -- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4ec0c21e0 msgr2=0x7fe4ec0c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec0c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 -- 172.21.15.88:0/1295947147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc009b30 con 0x7fe4ec06d890 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4ea59c700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000ea00 tx=0x7fe4e000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e0009720 con 0x7fe4ec06d890 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000c850 con 0x7fe4ec06d890 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec0c73e0 con 0x7fe4ec06d890 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000cbc0 con 0x7fe4ec06d890 2024-09-13T18:09:29.759 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.751+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec0c76a0 con 0x7fe4ec06d890 2024-09-13T18:09:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe4e000cd20 con 0x7fe4ec06d890 2024-09-13T18:09:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec0c47c0 con 0x7fe4ec06d890 2024-09-13T18:09:29.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4daffd700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 0x7fe4cc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe4e00842b0 con 0x7fe4ec06d890 2024-09-13T18:09:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4e9d9b700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 0x7fe4cc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:29.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.755+0000 7fe4e9d9b700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 0x7fe4cc068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc009000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:29.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.759+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe4e00515a0 con 0x7fe4ec06d890 2024-09-13T18:09:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.931+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4ec06f6b0 con 0x7fe4cc066730 2024-09-13T18:09:29.936 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.931+0000 7fe4daffd700 1 -- 172.21.15.88:0/1295947147 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe4dc003a40 con 0x7fe4cc066730 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 msgr2=0x7fe4cc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 0x7fe4cc068bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe4dc009e50 tx=0x7fe4dc009000 comp rx=0 tx=0).stop 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 msgr2=0x7fe4ec1561e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000ea00 tx=0x7fe4e000ed10 comp rx=0 tx=0).stop 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 shutdown_connections 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe4cc066730 0x7fe4cc068bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4ec0c1e00 0x7fe4ec0c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4ec0c21e0 0x7fe4ec0c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.941 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 --2- 172.21.15.88:0/1295947147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4ec06d890 0x7fe4ec1561e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 >> 172.21.15.88:0/1295947147 conn(0x7fe4ec0664b0 msgr2=0x7fe4ec0c8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 shutdown_connections 2024-09-13T18:09:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:29.935+0000 7fe4eb59e700 1 -- 172.21.15.88:0/1295947147 wait complete. 2024-09-13T18:09:29.942 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:09:29.958 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:09:29.958 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:30.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.075+0000 7fb4d926f700 1 Processor -- start 2024-09-13T18:09:30.082 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.075+0000 7fb4d926f700 1 -- start start 2024-09-13T18:09:30.083 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb4d40ca420 0x7fb4d406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40b1e20 con 0x7fb4d4158e50 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40c7690 con 0x7fb4d40ca420 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c7c50 con 0x7fb4d41531a0 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb4d40ca420 0x7fb4d406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d8a6e700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fb4d4158e50 0x7fb4d40ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:57966/0 (socket says 172.21.15.88:57966) 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb4d40ca420 0x7fb4d406bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:41988/0 (socket says 172.21.15.88:41988) 2024-09-13T18:09:30.084 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d8a6e700 1 -- 172.21.15.88:0/4092936942 learned_addr learned my addr 172.21.15.88:0/4092936942 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 -- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 msgr2=0x7fb4d406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 -- 172.21.15.88:0/4092936942 >> v1:172.21.15.94:6789/0 conn(0x7fb4d4158e50 legacy=0x7fb4d40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d37fe700 1 -- 172.21.15.88:0/4092936942 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819909501 0 0) 0x7fb4d40b1e20 con 0x7fb4d4158e50 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 -- 172.21.15.88:0/4092936942 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40b2070 con 0x7fb4d40ca420 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d3fff700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4cbfff700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d40ca420 0x7fb4d406bd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009850 tx=0x7fb4bc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa96b748ef5e1246 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d37fe700 1 -- 172.21.15.88:0/4092936942 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011830 con 0x7fb4d40ca420 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d37fe700 1 -- 172.21.15.88:0/4092936942 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4bc011990 con 0x7fb4d40ca420 2024-09-13T18:09:30.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d37fe700 1 -- 172.21.15.88:0/4092936942 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc011d40 con 0x7fb4d40ca420 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d40ca420 msgr2=0x7fb4d406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d40ca420 0x7fb4d406bd20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009850 tx=0x7fb4bc009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- 172.21.15.88:0/4092936942 shutdown_connections 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d40ca420 0x7fb4d406bd20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 --2- 172.21.15.88:0/4092936942 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- 172.21.15.88:0/4092936942 >> 172.21.15.88:0/4092936942 conn(0x7fb4d406eea0 msgr2=0x7fb4d406f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- 172.21.15.88:0/4092936942 shutdown_connections 2024-09-13T18:09:30.087 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.079+0000 7fb4d926f700 1 -- 172.21.15.88:0/4092936942 wait complete. 2024-09-13T18:09:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 Processor -- start 2024-09-13T18:09:30.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- start start 2024-09-13T18:09:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 0x7fb4d414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.090 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d40cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d4158e50 0x7fb4d4141a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d414aa20 con 0x7fb4d40ca420 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41415d0 con 0x7fb4d4158e50 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40cbe80 con 0x7fb4d41531a0 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 0x7fb4d414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 0x7fb4d414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59768/0 (socket says 172.21.15.88:59768) 2024-09-13T18:09:30.091 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 -- 172.21.15.88:0/3113387853 learned_addr learned my addr 172.21.15.88:0/3113387853 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4cbfff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d40cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d8a6e700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d4158e50 0x7fb4d4141a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 -- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 msgr2=0x7fb4d40cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4d41531a0 0x7fb4d40cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 -- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d4158e50 msgr2=0x7fb4d4141a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4d4158e50 0x7fb4d4141a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40094b0 con 0x7fb4d40ca420 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d3fff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 0x7fb4d414b850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ebe0 tx=0x7fb4c400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4009770 con 0x7fb4d40ca420 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c400c850 con 0x7fb4d40ca420 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c400cbe0 con 0x7fb4d40ca420 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4bc0094b0 con 0x7fb4d40ca420 2024-09-13T18:09:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.083+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d40cc3c0 con 0x7fb4d40ca420 2024-09-13T18:09:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4d40c78e0 con 0x7fb4d40ca420 2024-09-13T18:09:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb4c400cd40 con 0x7fb4d40ca420 2024-09-13T18:09:30.094 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb4b4066730 0x7fb4b4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb4c4084700 con 0x7fb4d40ca420 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4cbfff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb4b4066730 0x7fb4b4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7fb4b406ea50 0x7fb4b4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4b40715a0 con 0x7fb4b406ea50 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4c4084a70 con 0x7fb4d40ca420 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.087+0000 7fb4d8a6e700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7fb4b406ea50 0x7fb4b4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.091+0000 7fb4cbfff700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb4b4066730 0x7fb4b4068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009850 tx=0x7fb4bc01c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.091+0000 7fb4d8a6e700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7fb4b406ea50 0x7fb4b4070ed0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.091+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== osd.2 v2:172.21.15.88:6816/3613472173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fb4b40715a0 con 0x7fb4b406ea50 2024-09-13T18:09:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 --> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4d4141710 con 0x7fb4b406ea50 2024-09-13T18:09:30.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d17fa700 1 -- 172.21.15.88:0/3113387853 <== osd.2 v2:172.21.15.88:6816/3613472173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb4cc007260 con 0x7fb4b406ea50 2024-09-13T18:09:30.114 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:30.115 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:30.115 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:30.115 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7fb4b406ea50 msgr2=0x7fb4b4070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:6816/3613472173,v1:172.21.15.88:6817/3613472173] conn(0x7fb4b406ea50 0x7fb4b4070ed0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb4b4066730 msgr2=0x7fb4b4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb4b4066730 0x7fb4b4068bf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009850 tx=0x7fb4bc01c040 comp rx=0 tx=0).stop 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 msgr2=0x7fb4d414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d926f700 1 --2- 172.21.15.88:0/3113387853 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb4d40ca420 0x7fb4d414b850 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ebe0 tx=0x7fb4c400eef0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.107+0000 7fb4d8a6e700 1 -- 172.21.15.88:0/3113387853 reap_dead start 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.111+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 shutdown_connections 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.111+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 >> 172.21.15.88:0/3113387853 conn(0x7fb4d406eea0 msgr2=0x7fb4d406b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.111+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 shutdown_connections 2024-09-13T18:09:30.116 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.111+0000 7fb4d926f700 1 -- 172.21.15.88:0/3113387853 wait complete. 2024-09-13T18:09:30.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:09:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 Processor -- start 2024-09-13T18:09:30.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 -- start start 2024-09-13T18:09:30.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff3e40ca700 0x7ff3e40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3e40caae0 0x7ff3e40c5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e40cc480 con 0x7ff3e4152f70 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e415c800 con 0x7ff3e40caae0 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.231+0000 7ff3e914b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e415cae0 con 0x7ff3e40ca700 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3e40caae0 0x7ff3e40c5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff3e40caae0 0x7ff3e40c5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59776/0 (socket says 172.21.15.88:59776) 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 -- 172.21.15.88:0/1213253116 learned_addr learned my addr 172.21.15.88:0/1213253116 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:30.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e2d9d700 1 --2- 172.21.15.88:0/1213253116 >> v2:172.21.15.94:3300/0 conn(0x7ff3e40ca700 0x7ff3e40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 -- 172.21.15.88:0/1213253116 >> v2:172.21.15.94:3300/0 conn(0x7ff3e40ca700 msgr2=0x7ff3e40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:30.241 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 --2- 172.21.15.88:0/1213253116 >> v2:172.21.15.94:3300/0 conn(0x7ff3e40ca700 0x7ff3e40cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 -- 172.21.15.88:0/1213253116 >> v1:172.21.15.94:6789/0 conn(0x7ff3e4152f70 legacy=0x7ff3e406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 -- 172.21.15.88:0/1213253116 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e415cdc0 con 0x7ff3e40caae0 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e259c700 1 --2- 172.21.15.88:0/1213253116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e40caae0 0x7ff3e40c5610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40cfb60 tx=0x7ff3dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b1f224c259f502 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e1d9b700 1 -- 172.21.15.88:0/1213253116 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00e070 con 0x7ff3e40caae0 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e1d9b700 1 -- 172.21.15.88:0/1213253116 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3dc00b910 con 0x7ff3e40caae0 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e1d9b700 1 -- 172.21.15.88:0/1213253116 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3dc00bcc0 con 0x7ff3e40caae0 2024-09-13T18:09:30.242 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 -- 172.21.15.88:0/1213253116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e40caae0 msgr2=0x7ff3e40c5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 --2- 172.21.15.88:0/1213253116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e40caae0 0x7ff3e40c5610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff3e40cfb60 tx=0x7ff3dc00b330 comp rx=0 tx=0).stop 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 -- 172.21.15.88:0/1213253116 shutdown_connections 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 --2- 172.21.15.88:0/1213253116 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e40caae0 0x7ff3e40c5610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 --2- 172.21.15.88:0/1213253116 >> v2:172.21.15.94:3300/0 conn(0x7ff3e40ca700 0x7ff3e40cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 -- 172.21.15.88:0/1213253116 >> 172.21.15.88:0/1213253116 conn(0x7ff3e40cf130 msgr2=0x7ff3e40cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 -- 172.21.15.88:0/1213253116 shutdown_connections 2024-09-13T18:09:30.243 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.235+0000 7ff3e914b700 1 -- 172.21.15.88:0/1213253116 wait complete. 2024-09-13T18:09:30.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 Processor -- start 2024-09-13T18:09:30.244 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- start start 2024-09-13T18:09:30.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 0x7ff3e415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3e40caae0 0x7ff3e40cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 0x7ff3e40ce0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.245 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e40c8ec0 con 0x7ff3e4152f70 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e41e25f0 con 0x7ff3e40ca700 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e415b180 con 0x7ff3e40caae0 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 0x7ff3e40ce0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 0x7ff3e415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e2d9d700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 0x7ff3e415ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:42014/0 (socket says 172.21.15.88:42014) 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e2d9d700 1 -- 172.21.15.88:0/2780399429 learned_addr learned my addr 172.21.15.88:0/2780399429 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e259c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3e40caae0 0x7ff3e40cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 -- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3e40caae0 msgr2=0x7ff3e40cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3e40caae0 0x7ff3e40cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 -- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 msgr2=0x7ff3e415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 0x7ff3e415ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.246 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 -- 172.21.15.88:0/2780399429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc009b30 con 0x7ff3e4152f70 2024-09-13T18:09:30.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e359e700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 0x7ff3e40ce0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c3c0 tx=0x7ff3d400c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40052d0 con 0x7ff3e4152f70 2024-09-13T18:09:30.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4005430 con 0x7ff3e4152f70 2024-09-13T18:09:30.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e415c250 con 0x7ff3e4152f70 2024-09-13T18:09:30.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40055a0 con 0x7ff3e4152f70 2024-09-13T18:09:30.248 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.239+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e415b8f0 con 0x7ff3e4152f70 2024-09-13T18:09:30.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.243+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3d40038e0 con 0x7ff3e4152f70 2024-09-13T18:09:30.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.243+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3e40c8c40 con 0x7ff3e4152f70 2024-09-13T18:09:30.249 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.243+0000 7ff3cb7fe700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 0x7ff3d0068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.243+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff3d4083290 con 0x7ff3e4152f70 2024-09-13T18:09:30.250 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.243+0000 7ff3e2d9d700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 0x7ff3d0068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.251 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.247+0000 7ff3e2d9d700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 0x7ff3d0068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009cb0 tx=0x7ff3d8009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.251+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3d4050610 con 0x7ff3e4152f70 2024-09-13T18:09:30.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.423+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3e40c5b50 con 0x7ff3d0066760 2024-09-13T18:09:30.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.423+0000 7ff3cb7fe700 1 -- 172.21.15.88:0/2780399429 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff3d8009df0 con 0x7ff3d0066760 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 msgr2=0x7ff3d0068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 0x7ff3d0068c20 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009cb0 tx=0x7ff3d8009240 comp rx=0 tx=0).stop 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 msgr2=0x7ff3e40ce0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 0x7ff3e40ce0e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400c3c0 tx=0x7ff3d400c6d0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 shutdown_connections 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3d0066760 0x7ff3d0068c20 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3e40caae0 0x7ff3e40cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3e4152f70 0x7ff3e40ce0e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.435 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 --2- 172.21.15.88:0/2780399429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3e40ca700 0x7ff3e415ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 >> 172.21.15.88:0/2780399429 conn(0x7ff3e40cf130 msgr2=0x7ff3e40c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 shutdown_connections 2024-09-13T18:09:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.427+0000 7ff3e914b700 1 -- 172.21.15.88:0/2780399429 wait complete. 2024-09-13T18:09:30.436 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:09:30.450 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:09:30.451 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:30.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 Processor -- start 2024-09-13T18:09:30.574 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 -- start start 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcae80c6780 0x7fcae814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae8155da0 con 0x7fcae80c63a0 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae8156080 con 0x7fcae80c1b20 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.567+0000 7fcaeed9e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae8156360 con 0x7fcae80c6780 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaed59b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcae80c6780 0x7fcae814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaedd9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcae80c63a0 0x7fcae80c2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59526/0 (socket says 172.21.15.88:59526) 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaedd9c700 1 -- 172.21.15.88:0/4028155401 learned_addr learned my addr 172.21.15.88:0/4028155401 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaed59b700 1 -- 172.21.15.88:0/4028155401 >> v1:172.21.15.94:6789/0 conn(0x7fcae80c1b20 legacy=0x7fcae80c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaed59b700 1 -- 172.21.15.88:0/4028155401 >> v1:172.21.15.88:6789/0 conn(0x7fcae80c63a0 legacy=0x7fcae80c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaecd9a700 1 -- 172.21.15.88:0/4028155401 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197942469 0 0) 0x7fcae8156080 con 0x7fcae80c1b20 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaed59b700 1 -- 172.21.15.88:0/4028155401 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8156640 con 0x7fcae80c6780 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaed59b700 1 --2- 172.21.15.88:0/4028155401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c6780 0x7fcae814f9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009850 tx=0x7fcae4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a8ab10ca4e3b67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaecd9a700 1 -- 172.21.15.88:0/4028155401 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004230 con 0x7fcae80c6780 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaecd9a700 1 -- 172.21.15.88:0/4028155401 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4004390 con 0x7fcae80c6780 2024-09-13T18:09:30.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaecd9a700 1 -- 172.21.15.88:0/4028155401 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae40036c0 con 0x7fcae80c6780 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 -- 172.21.15.88:0/4028155401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c6780 msgr2=0x7fcae814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 --2- 172.21.15.88:0/4028155401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c6780 0x7fcae814f9b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcae4009850 tx=0x7fcae4009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 -- 172.21.15.88:0/4028155401 shutdown_connections 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 --2- 172.21.15.88:0/4028155401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c6780 0x7fcae814f9b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 -- 172.21.15.88:0/4028155401 >> 172.21.15.88:0/4028155401 conn(0x7fcae80c7120 msgr2=0x7fcae80c7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 -- 172.21.15.88:0/4028155401 shutdown_connections 2024-09-13T18:09:30.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.571+0000 7fcaeed9e700 1 -- 172.21.15.88:0/4028155401 wait complete. 2024-09-13T18:09:30.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 Processor -- start 2024-09-13T18:09:30.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- start start 2024-09-13T18:09:30.581 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcae80c1b20 0x7fcae814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 0x7fcae81df760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae80c6780 0x7fcae8151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81ef060 con 0x7fcae80c63a0 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81ee170 con 0x7fcae80c6780 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae81ee450 con 0x7fcae80c1b20 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 0x7fcae81df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 0x7fcae81df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59644/0 (socket says 172.21.15.88:59644) 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 -- 172.21.15.88:0/2863460959 learned_addr learned my addr 172.21.15.88:0/2863460959 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaee59d700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae80c6780 0x7fcae8151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaedd9c700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcae80c1b20 0x7fcae814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 -- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcae80c1b20 msgr2=0x7fcae814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcae80c1b20 0x7fcae814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.582 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 -- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae80c6780 msgr2=0x7fcae8151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcae80c6780 0x7fcae8151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40094b0 con 0x7fcae80c63a0 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaed59b700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 0x7fcae81df760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcae40090b0 tx=0x7fcae4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4011630 con 0x7fcae80c63a0 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae40117b0 con 0x7fcae80c63a0 2024-09-13T18:09:30.583 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae81ee730 con 0x7fcae80c63a0 2024-09-13T18:09:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4011b60 con 0x7fcae80c63a0 2024-09-13T18:09:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.575+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae81eecf0 con 0x7fcae80c63a0 2024-09-13T18:09:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcae4018050 con 0x7fcae80c63a0 2024-09-13T18:09:30.584 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcae814d070 con 0x7fcae80c63a0 2024-09-13T18:09:30.586 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcacc066760 0x7fcacc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcae4084d70 con 0x7fcae80c63a0 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fcacc06ea80 0x7fcacc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcacc0715d0 con 0x7fcacc06ea80 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcae4087350 con 0x7fcae80c63a0 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcaedd9c700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcacc066760 0x7fcacc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcaee59d700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fcacc06ea80 0x7fcacc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcaedd9c700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcacc066760 0x7fcacc068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcad8000f60 tx=0x7fcad8004a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.579+0000 7fcaee59d700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fcacc06ea80 0x7fcacc070f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.588 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.583+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== osd.3 v2:172.21.15.88:6808/3817728966 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fcacc0715d0 con 0x7fcacc06ea80 2024-09-13T18:09:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 --> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcae80c6d70 con 0x7fcacc06ea80 2024-09-13T18:09:30.606 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcade7fc700 1 -- 172.21.15.88:0/2863460959 <== osd.3 v2:172.21.15.88:6808/3817728966 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcae80c6d70 con 0x7fcacc06ea80 2024-09-13T18:09:30.607 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:30.607 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:30.607 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fcacc06ea80 msgr2=0x7fcacc070f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:6808/3817728966,v1:172.21.15.88:6809/3817728966] conn(0x7fcacc06ea80 0x7fcacc070f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcacc066760 msgr2=0x7fcacc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcacc066760 0x7fcacc068c20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcad8000f60 tx=0x7fcad8004a70 comp rx=0 tx=0).stop 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 msgr2=0x7fcae81df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 --2- 172.21.15.88:0/2863460959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcae80c63a0 0x7fcae81df760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcae40090b0 tx=0x7fcae4004770 comp rx=0 tx=0).stop 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaee59d700 1 -- 172.21.15.88:0/2863460959 reap_dead start 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 shutdown_connections 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.599+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 >> 172.21.15.88:0/2863460959 conn(0x7fcae80c7120 msgr2=0x7fcae8071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.603+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 shutdown_connections 2024-09-13T18:09:30.608 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.603+0000 7fcaeed9e700 1 -- 172.21.15.88:0/2863460959 wait complete. 2024-09-13T18:09:30.625 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:09:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 Processor -- start 2024-09-13T18:09:30.741 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 -- start start 2024-09-13T18:09:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff41006eea0 0x7ff41006f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410070400 con 0x7ff41006fbe0 2024-09-13T18:09:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4100b2260 con 0x7ff41006eea0 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff414ed3700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff41006f7c0 con 0x7ff4100c93f0 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff41006eea0 0x7ff41006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40effd700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7ff41006fbe0 0x7ff4100cac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:53730/0 (socket says 172.21.15.88:53730) 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40effd700 1 -- 172.21.15.88:0/3149439720 learned_addr learned my addr 172.21.15.88:0/3149439720 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:30.747 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff41006eea0 0x7ff41006f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:42310/0 (socket says 172.21.15.88:42310) 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40ffff700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:47814/0 (socket says 172.21.15.88:47814) 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 -- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 msgr2=0x7ff4100c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 -- 172.21.15.88:0/3149439720 >> v1:172.21.15.94:6789/0 conn(0x7ff41006fbe0 legacy=0x7ff4100cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 -- 172.21.15.88:0/3149439720 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100c9dc0 con 0x7ff41006eea0 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.735+0000 7ff40f7fe700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006eea0 0x7ff41006f280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009850 tx=0x7ff3f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc04e786fbe863c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff40e7fc700 1 -- 172.21.15.88:0/3149439720 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8011830 con 0x7ff41006eea0 2024-09-13T18:09:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff40e7fc700 1 -- 172.21.15.88:0/3149439720 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f8011990 con 0x7ff41006eea0 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff40e7fc700 1 -- 172.21.15.88:0/3149439720 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8011d40 con 0x7ff41006eea0 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 -- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006eea0 msgr2=0x7ff41006f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006eea0 0x7ff41006f280 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8009850 tx=0x7ff3f8009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 -- 172.21.15.88:0/3149439720 shutdown_connections 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 --2- 172.21.15.88:0/3149439720 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006eea0 0x7ff41006f280 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 -- 172.21.15.88:0/3149439720 >> 172.21.15.88:0/3149439720 conn(0x7ff4100cefa0 msgr2=0x7ff410066090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 -- 172.21.15.88:0/3149439720 shutdown_connections 2024-09-13T18:09:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.739+0000 7ff414ed3700 1 -- 172.21.15.88:0/3149439720 wait complete. 2024-09-13T18:09:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 Processor -- start 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 -- start start 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006fbe0 0x7ff41015af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41015cb80 con 0x7ff41006eea0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41015a540 con 0x7ff41006fbe0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4101ef940 con 0x7ff4100c93f0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59648/0 (socket says 172.21.15.88:59648) 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 -- 172.21.15.88:0/2833803650 learned_addr learned my addr 172.21.15.88:0/2833803650 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40effd700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006fbe0 0x7ff41015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40ffff700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 -- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 msgr2=0x7ff4100c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 -- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006fbe0 msgr2=0x7ff41015af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006fbe0 0x7ff41015af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 -- 172.21.15.88:0/2833803650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80094b0 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff40f7fe700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8014040 tx=0x7ff3f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8004610 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f80036c0 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4101f3610 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.743+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8003a90 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff41015ad30 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff41015b470 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff3f8003bf0 con 0x7ff41006eea0 2024-09-13T18:09:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff407fff700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 0x7ff3f0068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff3f8085090 con 0x7ff41006eea0 2024-09-13T18:09:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.747+0000 7ff40effd700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 0x7ff3f0068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.751+0000 7ff40effd700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 0x7ff3f0068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4101e3800 tx=0x7ff400009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:30.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.755+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff3f80523b0 con 0x7ff41006eea0 2024-09-13T18:09:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.919+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4101596a0 con 0x7ff3f0066730 2024-09-13T18:09:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff407fff700 1 -- 172.21.15.88:0/2833803650 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4000015c0 con 0x7ff3f0066730 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 msgr2=0x7ff3f0068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 0x7ff3f0068bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff4101e3800 tx=0x7ff400009040 comp rx=0 tx=0).stop 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 msgr2=0x7ff4101f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8014040 tx=0x7ff3f8004770 comp rx=0 tx=0).stop 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 shutdown_connections 2024-09-13T18:09:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff3f0066730 0x7ff3f0068bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff4100c93f0 0x7ff4100c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff41006fbe0 0x7ff41015af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 --2- 172.21.15.88:0/2833803650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff41006eea0 0x7ff4101f30d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 >> 172.21.15.88:0/2833803650 conn(0x7ff4100cefa0 msgr2=0x7ff4100b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 shutdown_connections 2024-09-13T18:09:30.931 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:30.923+0000 7ff414ed3700 1 -- 172.21.15.88:0/2833803650 wait complete. 2024-09-13T18:09:30.932 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:09:30.944 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:09:30.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:31.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 Processor -- start 2024-09-13T18:09:31.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 -- start start 2024-09-13T18:09:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe06406f0a0 0x7fe06406f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06406c890 con 0x7fe064150e70 2024-09-13T18:09:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe064157ed0 con 0x7fe06415f8d0 2024-09-13T18:09:31.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe06a6ec700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0641579e0 con 0x7fe06406f0a0 2024-09-13T18:09:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe06406f0a0 0x7fe06406f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe063fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe064150e70 0x7fe06406df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59536/0 (socket says 172.21.15.88:59536) 2024-09-13T18:09:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe06406f0a0 0x7fe06406f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59658/0 (socket says 172.21.15.88:59658) 2024-09-13T18:09:31.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe063fff700 1 -- 172.21.15.88:0/3688048577 learned_addr learned my addr 172.21.15.88:0/3688048577 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 -- 172.21.15.88:0/3688048577 >> v1:172.21.15.94:6789/0 conn(0x7fe06415f8d0 legacy=0x7fe064161cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 -- 172.21.15.88:0/3688048577 >> v1:172.21.15.88:6789/0 conn(0x7fe064150e70 legacy=0x7fe06406df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 -- 172.21.15.88:0/3688048577 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06406ea90 con 0x7fe06406f0a0 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe0637fe700 1 --2- 172.21.15.88:0/3688048577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe06406f4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe064157b20 tx=0x7fe058009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353903218f15c613 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe062ffd700 1 -- 172.21.15.88:0/3688048577 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058004230 con 0x7fe06406f0a0 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe062ffd700 1 -- 172.21.15.88:0/3688048577 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe058004390 con 0x7fe06406f0a0 2024-09-13T18:09:31.067 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.059+0000 7fe062ffd700 1 -- 172.21.15.88:0/3688048577 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580036c0 con 0x7fe06406f0a0 2024-09-13T18:09:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- 172.21.15.88:0/3688048577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 msgr2=0x7fe06406f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 --2- 172.21.15.88:0/3688048577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe06406f4e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe064157b20 tx=0x7fe058009b30 comp rx=0 tx=0).stop 2024-09-13T18:09:31.068 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- 172.21.15.88:0/3688048577 shutdown_connections 2024-09-13T18:09:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 --2- 172.21.15.88:0/3688048577 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe06406f4e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- 172.21.15.88:0/3688048577 >> 172.21.15.88:0/3688048577 conn(0x7fe06406a300 msgr2=0x7fe064070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- 172.21.15.88:0/3688048577 shutdown_connections 2024-09-13T18:09:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- 172.21.15.88:0/3688048577 wait complete. 2024-09-13T18:09:31.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 Processor -- start 2024-09-13T18:09:31.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.063+0000 7fe06a6ec700 1 -- start start 2024-09-13T18:09:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe0641f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.074 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe064150e70 0x7fe06414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe06415f8d0 0x7fe0641ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c4280 con 0x7fe06406f0a0 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641ecbb0 con 0x7fe064150e70 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c4bb0 con 0x7fe06415f8d0 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe0641f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe0641f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59674/0 (socket says 172.21.15.88:59674) 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 -- 172.21.15.88:0/489100030 learned_addr learned my addr 172.21.15.88:0/489100030 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.075 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe0637fe700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe064150e70 0x7fe06414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe068c89700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe06415f8d0 0x7fe0641ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 -- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe06415f8d0 msgr2=0x7fe0641ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe06415f8d0 0x7fe0641ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 -- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe064150e70 msgr2=0x7fe06414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe064150e70 0x7fe06414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.076 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580094b0 con 0x7fe06406f0a0 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe0637fe700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe064150e70 0x7fe06414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe063fff700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe0641f0b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c700 tx=0x7fe05400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054005d90 con 0x7fe06406f0a0 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540070d0 con 0x7fe06406f0a0 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0641f1070 con 0x7fe06406f0a0 2024-09-13T18:09:31.077 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054007440 con 0x7fe06406f0a0 2024-09-13T18:09:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe064157270 con 0x7fe06406f0a0 2024-09-13T18:09:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0640caae0 con 0x7fe06406f0a0 2024-09-13T18:09:31.078 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.067+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe0540075a0 con 0x7fe06406f0a0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe050066730 0x7fe050068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe054083450 con 0x7fe06406f0a0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fe05006ea50 0x7fe050070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe0637fe700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe050066730 0x7fe050068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe0500715a0 con 0x7fe05006ea50 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe054085b10 con 0x7fe06406f0a0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe068c89700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fe05006ea50 0x7fe050070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe0637fe700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe050066730 0x7fe050068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe064157b20 tx=0x7fe058008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.080 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe068c89700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fe05006ea50 0x7fe050070ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.081 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.071+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== osd.4 v2:172.21.15.94:6800/1669353113 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe0500715a0 con 0x7fe05006ea50 2024-09-13T18:09:31.097 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 --> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe06406c240 con 0x7fe05006ea50 2024-09-13T18:09:31.098 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe060ff9700 1 -- 172.21.15.88:0/489100030 <== osd.4 v2:172.21.15.94:6800/1669353113 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe05c003a20 con 0x7fe05006ea50 2024-09-13T18:09:31.098 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:31.098 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:31.098 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:31.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fe05006ea50 msgr2=0x7fe050070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6800/1669353113,v1:172.21.15.94:6801/1669353113] conn(0x7fe05006ea50 0x7fe050070ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.099 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe050066730 msgr2=0x7fe050068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe050066730 0x7fe050068bf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe064157b20 tx=0x7fe058008030 comp rx=0 tx=0).stop 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 msgr2=0x7fe0641f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 --2- 172.21.15.88:0/489100030 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe06406f0a0 0x7fe0641f0b30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe05400c700 tx=0x7fe05400cac0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe068c89700 1 -- 172.21.15.88:0/489100030 reap_dead start 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 shutdown_connections 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 >> 172.21.15.88:0/489100030 conn(0x7fe06406a300 msgr2=0x7fe06406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.091+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 shutdown_connections 2024-09-13T18:09:31.100 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.095+0000 7fe06a6ec700 1 -- 172.21.15.88:0/489100030 wait complete. 2024-09-13T18:09:31.112 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:09:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 Processor -- start 2024-09-13T18:09:31.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 -- start start 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf180d4ba0 0x7fcf1804a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf18046730 con 0x7fcf180dea90 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf18046bc0 con 0x7fcf1804abc0 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf18007020 con 0x7fcf180d4ba0 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf180d4ba0 0x7fcf1804a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf180dea90 0x7fcf180e5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59542/0 (socket says 172.21.15.88:59542) 2024-09-13T18:09:31.230 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1f7fe700 1 -- 172.21.15.88:0/3057133056 learned_addr learned my addr 172.21.15.88:0/3057133056 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1effd700 1 -- 172.21.15.88:0/3057133056 >> v1:172.21.15.94:6789/0 conn(0x7fcf1804abc0 legacy=0x7fcf18006390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1effd700 1 -- 172.21.15.88:0/3057133056 >> v1:172.21.15.88:6789/0 conn(0x7fcf180dea90 legacy=0x7fcf180e5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1effd700 1 -- 172.21.15.88:0/3057133056 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180defd0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.223+0000 7fcf1effd700 1 --2- 172.21.15.88:0/3057133056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf1804a680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009850 tx=0x7fcf10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8906a3920455fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1dffb700 1 -- 172.21.15.88:0/3057133056 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000f8a0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1dffb700 1 -- 172.21.15.88:0/3057133056 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000fa00 con 0x7fcf180d4ba0 2024-09-13T18:09:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1dffb700 1 -- 172.21.15.88:0/3057133056 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000fd90 con 0x7fcf180d4ba0 2024-09-13T18:09:31.232 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- 172.21.15.88:0/3057133056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 msgr2=0x7fcf1804a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/3057133056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf1804a680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009850 tx=0x7fcf10009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- 172.21.15.88:0/3057133056 shutdown_connections 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/3057133056 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf1804a680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- 172.21.15.88:0/3057133056 >> 172.21.15.88:0/3057133056 conn(0x7fcf1804fd00 msgr2=0x7fcf18050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- 172.21.15.88:0/3057133056 shutdown_connections 2024-09-13T18:09:31.233 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- 172.21.15.88:0/3057133056 wait complete. 2024-09-13T18:09:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 Processor -- start 2024-09-13T18:09:31.234 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.227+0000 7fcf1ffff700 1 -- start start 2024-09-13T18:09:31.235 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf1804abc0 0x7fcf18047e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf180dea90 0x7fcf180d6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180d7a90 con 0x7fcf180d4ba0 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180d0f90 con 0x7fcf180dea90 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180d8490 con 0x7fcf1804abc0 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59688/0 (socket says 172.21.15.88:59688) 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 -- 172.21.15.88:0/2563004669 learned_addr learned my addr 172.21.15.88:0/2563004669 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1f7fe700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf180dea90 0x7fcf180d6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.236 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1effd700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf1804abc0 0x7fcf18047e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 -- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf1804abc0 msgr2=0x7fcf18047e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf1804abc0 0x7fcf18047e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 -- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf180dea90 msgr2=0x7fcf180d6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.237 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf180dea90 0x7fcf180d6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 -- 172.21.15.88:0/2563004669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf100094b0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1e7fc700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c4d0 tx=0x7fcf0800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080052d0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf08005430 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf18049f10 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf080055a0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf180d0660 con 0x7fcf180d4ba0 2024-09-13T18:09:31.238 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf180d4f80 con 0x7fcf180d4ba0 2024-09-13T18:09:31.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.231+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fcf080038c0 con 0x7fcf180d4ba0 2024-09-13T18:09:31.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.235+0000 7fcf17fff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 0x7fcf00068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.235+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcf08083590 con 0x7fcf180d4ba0 2024-09-13T18:09:31.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.235+0000 7fcf1effd700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 0x7fcf00068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.240 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.235+0000 7fcf1effd700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 0x7fcf00068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009fd0 tx=0x7fcf1001b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.247 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.243+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fcf08050880 con 0x7fcf180d4ba0 2024-09-13T18:09:31.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.403+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf180460e0 con 0x7fcf00066730 2024-09-13T18:09:31.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf17fff700 1 -- 172.21.15.88:0/2563004669 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcf1000fcf0 con 0x7fcf00066730 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 msgr2=0x7fcf00068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 0x7fcf00068bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf10009fd0 tx=0x7fcf1001b040 comp rx=0 tx=0).stop 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 msgr2=0x7fcf180d5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800c4d0 tx=0x7fcf0800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 shutdown_connections 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fcf00066730 0x7fcf00068bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.414 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcf180dea90 0x7fcf180d6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf180d4ba0 0x7fcf180d5c20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 --2- 172.21.15.88:0/2563004669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcf1804abc0 0x7fcf18047e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 >> 172.21.15.88:0/2563004669 conn(0x7fcf1804fd00 msgr2=0x7fcf18032a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 shutdown_connections 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.407+0000 7fcf1ffff700 1 -- 172.21.15.88:0/2563004669 wait complete. 2024-09-13T18:09:31.415 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:09:31.426 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:09:31.427 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.539+0000 7ff95359e700 1 Processor -- start 2024-09-13T18:09:31.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.539+0000 7ff95359e700 1 -- start start 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff95406e330 0x7ff9540c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95359e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff95406e710 0x7ff954150a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95359e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540c49c0 con 0x7ff9540c77f0 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9540c6100 con 0x7ff95406e330 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95359e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff954156ca0 con 0x7ff95406e710 2024-09-13T18:09:31.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff95406e330 0x7ff9540c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff95406e330 0x7ff9540c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59694/0 (socket says 172.21.15.88:59694) 2024-09-13T18:09:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 -- 172.21.15.88:0/1210068296 learned_addr learned my addr 172.21.15.88:0/1210068296 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff952d9d700 1 --2- 172.21.15.88:0/1210068296 >> v2:172.21.15.94:3300/0 conn(0x7ff95406e710 0x7ff954150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 -- 172.21.15.88:0/1210068296 >> v2:172.21.15.94:3300/0 conn(0x7ff95406e710 msgr2=0x7ff954150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 --2- 172.21.15.88:0/1210068296 >> v2:172.21.15.94:3300/0 conn(0x7ff95406e710 0x7ff954150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 -- 172.21.15.88:0/1210068296 >> v1:172.21.15.94:6789/0 conn(0x7ff9540c77f0 legacy=0x7ff9541571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 -- 172.21.15.88:0/1210068296 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9540c63a0 con 0x7ff95406e330 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95259c700 1 --2- 172.21.15.88:0/1210068296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e330 0x7ff9540c72b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9540c8030 tx=0x7ff93c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e0a38e94a1e820 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95159a700 1 -- 172.21.15.88:0/1210068296 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011830 con 0x7ff95406e330 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95159a700 1 -- 172.21.15.88:0/1210068296 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c011990 con 0x7ff95406e330 2024-09-13T18:09:31.551 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.543+0000 7ff95159a700 1 -- 172.21.15.88:0/1210068296 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c011d20 con 0x7ff95406e330 2024-09-13T18:09:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- 172.21.15.88:0/1210068296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e330 msgr2=0x7ff9540c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 --2- 172.21.15.88:0/1210068296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e330 0x7ff9540c72b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff9540c8030 tx=0x7ff93c009bf0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.552 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- 172.21.15.88:0/1210068296 shutdown_connections 2024-09-13T18:09:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 --2- 172.21.15.88:0/1210068296 >> v2:172.21.15.94:3300/0 conn(0x7ff95406e710 0x7ff954150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 --2- 172.21.15.88:0/1210068296 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e330 0x7ff9540c72b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- 172.21.15.88:0/1210068296 >> 172.21.15.88:0/1210068296 conn(0x7ff954066090 msgr2=0x7ff9540664a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- 172.21.15.88:0/1210068296 shutdown_connections 2024-09-13T18:09:31.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- 172.21.15.88:0/1210068296 wait complete. 2024-09-13T18:09:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 Processor -- start 2024-09-13T18:09:31.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.547+0000 7ff95359e700 1 -- start start 2024-09-13T18:09:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff95406e330 0x7ff9540cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 0x7ff9541f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9540c77f0 0x7ff954144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cb1c0 con 0x7ff95406e710 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff954151a20 con 0x7ff9540c77f0 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540cad30 con 0x7ff95406e330 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 0x7ff9541f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 0x7ff9541f1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59700/0 (socket says 172.21.15.88:59700) 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 -- 172.21.15.88:0/4030025663 learned_addr learned my addr 172.21.15.88:0/4030025663 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95259c700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff95406e330 0x7ff9540cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff952d9d700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9540c77f0 0x7ff954144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 -- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff95406e330 msgr2=0x7ff9540cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff95406e330 0x7ff9540cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 -- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9540c77f0 msgr2=0x7ff954144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9540c77f0 0x7ff954144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009570 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff952d9d700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff9540c77f0 0x7ff954144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff951d9b700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 0x7ff9541f1db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c4d0 tx=0x7ff94400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440052d0 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff944005430 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff954152920 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9440055a0 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9540ca750 con 0x7ff95406e710 2024-09-13T18:09:31.559 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.551+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff9540c9b10 con 0x7ff95406e710 2024-09-13T18:09:31.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff9440038c0 con 0x7ff95406e710 2024-09-13T18:09:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff934066760 0x7ff934068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.561 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff944083c30 con 0x7ff95406e710 2024-09-13T18:09:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7ff93406ea80 0x7ff934070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9340715d0 con 0x7ff93406ea80 2024-09-13T18:09:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff944084080 con 0x7ff95406e710 2024-09-13T18:09:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff95259c700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff934066760 0x7ff934068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff952d9d700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7ff93406ea80 0x7ff934070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff95259c700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff934066760 0x7ff934068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff93c000c00 tx=0x7ff93c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.555+0000 7ff952d9d700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7ff93406ea80 0x7ff934070f00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.559+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== osd.5 v2:172.21.15.94:6816/2317600927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7ff9340715d0 con 0x7ff93406ea80 2024-09-13T18:09:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 --> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff9540c6c40 con 0x7ff93406ea80 2024-09-13T18:09:31.585 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff94affd700 1 -- 172.21.15.88:0/4030025663 <== osd.5 v2:172.21.15.94:6816/2317600927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff94c00f040 con 0x7ff93406ea80 2024-09-13T18:09:31.586 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:31.586 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:31.586 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7ff93406ea80 msgr2=0x7ff934070f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6816/2317600927,v1:172.21.15.94:6817/2317600927] conn(0x7ff93406ea80 0x7ff934070f00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff934066760 msgr2=0x7ff934068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff934066760 0x7ff934068c20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff93c000c00 tx=0x7ff93c008030 comp rx=0 tx=0).stop 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 msgr2=0x7ff9541f1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 --2- 172.21.15.88:0/4030025663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff95406e710 0x7ff9541f1db0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff94400c4d0 tx=0x7ff94400c7e0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff952d9d700 1 -- 172.21.15.88:0/4030025663 reap_dead start 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 shutdown_connections 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 >> 172.21.15.88:0/4030025663 conn(0x7ff954066090 msgr2=0x7ff954154900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 shutdown_connections 2024-09-13T18:09:31.587 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.579+0000 7ff95359e700 1 -- 172.21.15.88:0/4030025663 wait complete. 2024-09-13T18:09:31.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:09:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.711+0000 7f5de0a3b700 1 Processor -- start 2024-09-13T18:09:31.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.711+0000 7f5de0a3b700 1 -- start start 2024-09-13T18:09:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5de0a3b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ddc14f390 0x7f5ddc0c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5de0a3b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc1551e0 0x7f5ddc0c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5de0a3b700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ddc070000 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.721 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5de0a3b700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ddc0705c0 con 0x7f5ddc14f390 2024-09-13T18:09:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5de0a3b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc155760 con 0x7f5ddc1551e0 2024-09-13T18:09:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ddc14f390 0x7f5ddc0c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5dd2ffd700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc1551e0 0x7f5ddc0c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ddc14f390 0x7f5ddc0c6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:42354/0 (socket says 172.21.15.88:42354) 2024-09-13T18:09:31.722 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1319829179 learned_addr learned my addr 172.21.15.88:0/1319829179 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc1551e0 msgr2=0x7f5ddc0c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 --2- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc1551e0 0x7f5ddc0c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1319829179 >> v1:172.21.15.94:6789/0 conn(0x7f5ddc0b0b00 legacy=0x7f5ddc070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1319829179 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc155a20 con 0x7f5ddc14f390 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddb7fe700 1 --2- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc14f390 0x7f5ddc0c6970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00aae0 tx=0x7f5dcc00adf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faa5a8bd393f9284 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddaffd700 1 -- 172.21.15.88:0/1319829179 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00cb30 con 0x7f5ddc14f390 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddaffd700 1 -- 172.21.15.88:0/1319829179 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc00cc90 con 0x7f5ddc14f390 2024-09-13T18:09:31.723 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.715+0000 7f5ddaffd700 1 -- 172.21.15.88:0/1319829179 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc018400 con 0x7f5ddc14f390 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc14f390 msgr2=0x7f5ddc0c6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc14f390 0x7f5ddc0c6970 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00aae0 tx=0x7f5dcc00adf0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1319829179 shutdown_connections 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc1551e0 0x7f5ddc0c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1319829179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc14f390 0x7f5ddc0c6970 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.724 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1319829179 >> 172.21.15.88:0/1319829179 conn(0x7f5ddc0cb590 msgr2=0x7f5ddc0c7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1319829179 shutdown_connections 2024-09-13T18:09:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1319829179 wait complete. 2024-09-13T18:09:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 Processor -- start 2024-09-13T18:09:31.725 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- start start 2024-09-13T18:09:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.727 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc14f390 0x7f5ddc1ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc1551e0 0x7f5ddc1ef590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1de410 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1dc4b0 con 0x7f5ddc1551e0 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5de0a3b700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc1dee40 con 0x7f5ddc14f390 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5ddb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5ddb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59702/0 (socket says 172.21.15.88:59702) 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.719+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1040773574 learned_addr learned my addr 172.21.15.88:0/1040773574 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddbfff700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc1551e0 0x7f5ddc1ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5dd2ffd700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc14f390 0x7f5ddc1ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc14f390 msgr2=0x7f5ddc1ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc14f390 0x7f5ddc1ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc1551e0 msgr2=0x7f5ddc1ef590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc1551e0 0x7f5ddc1ef590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 -- 172.21.15.88:0/1040773574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dcc00a710 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5ddb7fe700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0c74e0 tx=0x7f5dcc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.729 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc00cb30 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc003af0 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc1df630 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc003ea0 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc1dfbf0 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ddc1eee30 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.730 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.723+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f5dcc018400 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.727+0000 7f5dd8ff9700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 0x7f5dbc068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:31.731 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.727+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5dcc085770 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.727+0000 7f5dd2ffd700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 0x7f5dbc068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:31.732 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.727+0000 7f5dd2ffd700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 0x7f5dbc068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0c7150 tx=0x7f5dc4009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:31.739 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.735+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f5dcc052a70 con 0x7f5ddc0b0b00 2024-09-13T18:09:31.909 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.903+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ddc1e05b0 con 0x7f5dbc066730 2024-09-13T18:09:31.910 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.903+0000 7f5dd8ff9700 1 -- 172.21.15.88:0/1040773574 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5ddc1e05b0 con 0x7f5dbc066730 2024-09-13T18:09:31.913 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 msgr2=0x7f5dbc068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 0x7f5dbc068bf0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0c7150 tx=0x7f5dc4009240 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 msgr2=0x7f5ddc0c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc0c74e0 tx=0x7f5dcc004770 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 shutdown_connections 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f5dbc066730 0x7f5dbc068bf0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ddc14f390 0x7f5ddc1ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ddc1551e0 0x7f5ddc1ef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 --2- 172.21.15.88:0/1040773574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ddc0b0b00 0x7f5ddc0c67d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 >> 172.21.15.88:0/1040773574 conn(0x7f5ddc0cb590 msgr2=0x7f5ddc154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 shutdown_connections 2024-09-13T18:09:31.914 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:31.907+0000 7f5de0a3b700 1 -- 172.21.15.88:0/1040773574 wait complete. 2024-09-13T18:09:31.915 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:09:31.926 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:09:31.926 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.043+0000 7f19a4283700 1 Processor -- start 2024-09-13T18:09:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.043+0000 7f19a4283700 1 -- start start 2024-09-13T18:09:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f199c0cbad0 0x7f199c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c39d0 con 0x7f199c15d0f0 2024-09-13T18:09:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c159ed0 con 0x7f199c0cbad0 2024-09-13T18:09:32.052 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c159390 con 0x7f199c0cbeb0 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a201f700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f199c0cbad0 0x7f199c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:47858/0 (socket says 172.21.15.88:47858) 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 -- 172.21.15.88:0/3500911109 learned_addr learned my addr 172.21.15.88:0/3500911109 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 -- 172.21.15.88:0/3500911109 >> v2:172.21.15.94:3300/0 conn(0x7f199c0cbad0 msgr2=0x7f199c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 --2- 172.21.15.88:0/3500911109 >> v2:172.21.15.94:3300/0 conn(0x7f199c0cbad0 0x7f199c15cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 -- 172.21.15.88:0/3500911109 >> v1:172.21.15.94:6789/0 conn(0x7f199c15d0f0 legacy=0x7f199c152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 -- 172.21.15.88:0/3500911109 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c159630 con 0x7f199c0cbeb0 2024-09-13T18:09:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a181e700 1 --2- 172.21.15.88:0/3500911109 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1998009910 tx=0x7f1998009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=485146bc7eb238c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a101d700 1 -- 172.21.15.88:0/3500911109 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011830 con 0x7f199c0cbeb0 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a101d700 1 -- 172.21.15.88:0/3500911109 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998011990 con 0x7f199c0cbeb0 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a101d700 1 -- 172.21.15.88:0/3500911109 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011d40 con 0x7f199c0cbeb0 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- 172.21.15.88:0/3500911109 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 msgr2=0x7f199c0caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 --2- 172.21.15.88:0/3500911109 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1998009910 tx=0x7f1998009c20 comp rx=0 tx=0).stop 2024-09-13T18:09:32.056 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- 172.21.15.88:0/3500911109 shutdown_connections 2024-09-13T18:09:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 --2- 172.21.15.88:0/3500911109 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c0cbeb0 0x7f199c0caa50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 --2- 172.21.15.88:0/3500911109 >> v2:172.21.15.94:3300/0 conn(0x7f199c0cbad0 0x7f199c15cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- 172.21.15.88:0/3500911109 >> 172.21.15.88:0/3500911109 conn(0x7f199c071800 msgr2=0x7f199c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- 172.21.15.88:0/3500911109 shutdown_connections 2024-09-13T18:09:32.057 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.047+0000 7f19a4283700 1 -- 172.21.15.88:0/3500911109 wait complete. 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 Processor -- start 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 -- start start 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 0x7f199c15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f199c0cbeb0 0x7f199c14e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c15d0f0 0x7f199c151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c155120 con 0x7f199c0cbad0 2024-09-13T18:09:32.059 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c1553e0 con 0x7f199c0cbeb0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a4283700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c153cc0 con 0x7f199c15d0f0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 0x7f199c15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 0x7f199c15b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59716/0 (socket says 172.21.15.88:59716) 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 -- 172.21.15.88:0/1008661913 learned_addr learned my addr 172.21.15.88:0/1008661913 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a2820700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c15d0f0 0x7f199c151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a181e700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f199c0cbeb0 0x7f199c14e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 -- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c15d0f0 msgr2=0x7f199c151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f199c15d0f0 0x7f199c151b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 -- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f199c0cbeb0 msgr2=0x7f199c14e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f199c0cbeb0 0x7f199c14e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.051+0000 7f19a201f700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998009570 con 0x7f199c0cbad0 2024-09-13T18:09:32.060 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f19a201f700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 0x7f199c15b890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f199000e840 tx=0x7f199000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900095a0 con 0x7f199c0cbad0 2024-09-13T18:09:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990013680 con 0x7f199c0cbad0 2024-09-13T18:09:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c1556a0 con 0x7f199c0cbad0 2024-09-13T18:09:32.061 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900139f0 con 0x7f199c0cbad0 2024-09-13T18:09:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c155c60 con 0x7f199c0cbad0 2024-09-13T18:09:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f199c0b4ab0 con 0x7f199c0cbad0 2024-09-13T18:09:32.062 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.055+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f1990013b50 con 0x7f199c0cbad0 2024-09-13T18:09:32.063 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1980066760 0x7f1980068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f19900840e0 con 0x7f199c0cbad0 2024-09-13T18:09:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f19a181e700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1980066760 0x7f1980068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f198006ea80 0x7f1980070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19800715d0 con 0x7f198006ea80 2024-09-13T18:09:32.064 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19900867a0 con 0x7f199c0cbad0 2024-09-13T18:09:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f19a2820700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f198006ea80 0x7f1980070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f19a181e700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1980066760 0x7f1980068c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1998000c00 tx=0x7f1998008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.065 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f19a2820700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f198006ea80 0x7f1980070f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.066 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.059+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== osd.6 v2:172.21.15.94:6824/1539943625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f19800715d0 con 0x7f198006ea80 2024-09-13T18:09:32.085 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 --> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f199c0b2680 con 0x7f198006ea80 2024-09-13T18:09:32.086 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f198effd700 1 -- 172.21.15.88:0/1008661913 <== osd.6 v2:172.21.15.94:6824/1539943625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f199c0b2680 con 0x7f198006ea80 2024-09-13T18:09:32.087 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:32.087 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:32.087 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f198006ea80 msgr2=0x7f1980070f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6824/1539943625,v1:172.21.15.94:6825/1539943625] conn(0x7f198006ea80 0x7f1980070f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1980066760 msgr2=0x7f1980068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f1980066760 0x7f1980068c20 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1998000c00 tx=0x7f1998008030 comp rx=0 tx=0).stop 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 msgr2=0x7f199c15b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 --2- 172.21.15.88:0/1008661913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cbad0 0x7f199c15b890 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f199000e840 tx=0x7f199000eb50 comp rx=0 tx=0).stop 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a2820700 1 -- 172.21.15.88:0/1008661913 reap_dead start 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 shutdown_connections 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 >> 172.21.15.88:0/1008661913 conn(0x7f199c071800 msgr2=0x7f199c156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 shutdown_connections 2024-09-13T18:09:32.088 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.079+0000 7f19a4283700 1 -- 172.21.15.88:0/1008661913 wait complete. 2024-09-13T18:09:32.099 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:09:32.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.211+0000 7fe11340a700 1 Processor -- start 2024-09-13T18:09:32.219 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.211+0000 7fe11340a700 1 -- start start 2024-09-13T18:09:32.220 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe10c06c170 0x7fe10c06c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe10c0c5090 0x7fe10c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe10c15e370 con 0x7fe10c06ca90 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c15df50 con 0x7fe10c06c170 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10c15d3a0 con 0x7fe10c0c5090 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe10c06c170 0x7fe10c06c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe10c06c170 0x7fe10c06c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59718/0 (socket says 172.21.15.88:59718) 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 -- 172.21.15.88:0/3523642218 learned_addr learned my addr 172.21.15.88:0/3523642218 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112c09700 1 --2- 172.21.15.88:0/3523642218 >> v2:172.21.15.94:3300/0 conn(0x7fe10c0c5090 0x7fe10c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 -- 172.21.15.88:0/3523642218 >> v2:172.21.15.94:3300/0 conn(0x7fe10c0c5090 msgr2=0x7fe10c1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 --2- 172.21.15.88:0/3523642218 >> v2:172.21.15.94:3300/0 conn(0x7fe10c0c5090 0x7fe10c1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 -- 172.21.15.88:0/3523642218 >> v1:172.21.15.94:6789/0 conn(0x7fe10c06ca90 legacy=0x7fe10c071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 -- 172.21.15.88:0/3523642218 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0c1660 con 0x7fe10c06c170 2024-09-13T18:09:32.221 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe112408700 1 --2- 172.21.15.88:0/3523642218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06c170 0x7fe10c06c550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06e1b0 tx=0x7fe0fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc637d165dc88107 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe111406700 1 -- 172.21.15.88:0/3523642218 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc004230 con 0x7fe10c06c170 2024-09-13T18:09:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe111406700 1 -- 172.21.15.88:0/3523642218 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0fc004390 con 0x7fe10c06c170 2024-09-13T18:09:32.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe111406700 1 -- 172.21.15.88:0/3523642218 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0fc0036c0 con 0x7fe10c06c170 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- 172.21.15.88:0/3523642218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06c170 msgr2=0x7fe10c06c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 --2- 172.21.15.88:0/3523642218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06c170 0x7fe10c06c550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06e1b0 tx=0x7fe0fc009bf0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- 172.21.15.88:0/3523642218 shutdown_connections 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 --2- 172.21.15.88:0/3523642218 >> v2:172.21.15.94:3300/0 conn(0x7fe10c0c5090 0x7fe10c1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 --2- 172.21.15.88:0/3523642218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06c170 0x7fe10c06c550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- 172.21.15.88:0/3523642218 >> 172.21.15.88:0/3523642218 conn(0x7fe10c0664b0 msgr2=0x7fe10c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- 172.21.15.88:0/3523642218 shutdown_connections 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- 172.21.15.88:0/3523642218 wait complete. 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 Processor -- start 2024-09-13T18:09:32.223 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.215+0000 7fe11340a700 1 -- start start 2024-09-13T18:09:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10c06c170 0x7fe10c155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 0x7fe10c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.225 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c148960 con 0x7fe10c06ca90 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c15a500 con 0x7fe10c06c170 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c14d740 con 0x7fe10c0c5090 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe111c07700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe111c07700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59732/0 (socket says 172.21.15.88:59732) 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe111c07700 1 -- 172.21.15.88:0/1104766148 learned_addr learned my addr 172.21.15.88:0/1104766148 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 0x7fe10c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112408700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10c06c170 0x7fe10c155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 -- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10c06c170 msgr2=0x7fe10c155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10c06c170 0x7fe10c155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 -- 172.21.15.88:0/1104766148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 msgr2=0x7fe10c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 -- 172.21.15.88:0/1104766148 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc009570 con 0x7fe10c0c5090 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe111c07700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:09:32.226 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe112c09700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 0x7fe10c158d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe104007d90 tx=0x7fe10400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104018070 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10400eb30 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe10c14da20 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104003a40 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10c14b860 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.219+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe10c0c61c0 con 0x7fe10c0c5090 2024-09-13T18:09:32.227 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.223+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe104014420 con 0x7fe10c0c5090 2024-09-13T18:09:32.228 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.223+0000 7fe10affd700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 0x7fe0f8068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.223+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe104084210 con 0x7fe10c0c5090 2024-09-13T18:09:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.223+0000 7fe112408700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 0x7fe0f8068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.229 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.223+0000 7fe112408700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 0x7fe0f8068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06e1b0 tx=0x7fe0fc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.231+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fe1040513e0 con 0x7fe10c0c5090 2024-09-13T18:09:32.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.403+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe10c15db70 con 0x7fe0f8066730 2024-09-13T18:09:32.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.403+0000 7fe10affd700 1 -- 172.21.15.88:0/1104766148 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe0fc0038d0 con 0x7fe0f8066730 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 msgr2=0x7fe0f8068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 0x7fe0f8068bf0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe10c06e1b0 tx=0x7fe0fc008030 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 msgr2=0x7fe10c158d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 0x7fe10c158d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe104007d90 tx=0x7fe10400e3c0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 shutdown_connections 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe0f8066730 0x7fe0f8068bf0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe10c0c5090 0x7fe10c158d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe10c06ca90 0x7fe10c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 --2- 172.21.15.88:0/1104766148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe10c06c170 0x7fe10c155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 >> 172.21.15.88:0/1104766148 conn(0x7fe10c0664b0 msgr2=0x7fe10c0c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 shutdown_connections 2024-09-13T18:09:32.412 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.407+0000 7fe11340a700 1 -- 172.21.15.88:0/1104766148 wait complete. 2024-09-13T18:09:32.413 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:09:32.424 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:09:32.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:09:32.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.534+0000 7fe59a6a4700 1 Processor -- start 2024-09-13T18:09:32.543 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.534+0000 7fe59a6a4700 1 -- start start 2024-09-13T18:09:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe59a6a4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5941530a0 0x7fe59415a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe59a6a4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59406d570 con 0x7fe594153480 2024-09-13T18:09:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe59a6a4700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59406fcc0 con 0x7fe5940c6230 2024-09-13T18:09:32.545 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe59a6a4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59406c960 con 0x7fe5941530a0 2024-09-13T18:09:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe598ea1700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe594153480 0x7fe59406eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59556/0 (socket says 172.21.15.88:59556) 2024-09-13T18:09:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe5996a2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5941530a0 0x7fe59415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.546 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe598ea1700 1 -- 172.21.15.88:0/1215069871 learned_addr learned my addr 172.21.15.88:0/1215069871 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:32.547 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe58bfff700 1 -- 172.21.15.88:0/1215069871 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174687130 0 0) 0x7fe59406d570 con 0x7fe594153480 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe58bfff700 1 -- 172.21.15.88:0/1215069871 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5800035d0 con 0x7fe594153480 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe5996a2700 1 -- 172.21.15.88:0/1215069871 >> v1:172.21.15.94:6789/0 conn(0x7fe5940c6230 legacy=0x7fe59406f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe5996a2700 1 -- 172.21.15.88:0/1215069871 >> v1:172.21.15.88:6789/0 conn(0x7fe594153480 legacy=0x7fe59406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe5996a2700 1 -- 172.21.15.88:0/1215069871 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59406cc40 con 0x7fe5941530a0 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe5996a2700 1 --2- 172.21.15.88:0/1215069871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5941530a0 0x7fe59415a520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe590009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=210ac8ab11ce279f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe58bfff700 1 -- 172.21.15.88:0/1215069871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011830 con 0x7fe5941530a0 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe58bfff700 1 -- 172.21.15.88:0/1215069871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe590011990 con 0x7fe5941530a0 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.538+0000 7fe58bfff700 1 -- 172.21.15.88:0/1215069871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590011d00 con 0x7fe5941530a0 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- 172.21.15.88:0/1215069871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5941530a0 msgr2=0x7fe59415a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.548 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 --2- 172.21.15.88:0/1215069871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5941530a0 0x7fe59415a520 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe590009850 tx=0x7fe590009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:32.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- 172.21.15.88:0/1215069871 shutdown_connections 2024-09-13T18:09:32.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 --2- 172.21.15.88:0/1215069871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5941530a0 0x7fe59415a520 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- 172.21.15.88:0/1215069871 >> 172.21.15.88:0/1215069871 conn(0x7fe59406a300 msgr2=0x7fe59406a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- 172.21.15.88:0/1215069871 shutdown_connections 2024-09-13T18:09:32.549 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- 172.21.15.88:0/1215069871 wait complete. 2024-09-13T18:09:32.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 Processor -- start 2024-09-13T18:09:32.550 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.542+0000 7fe59a6a4700 1 -- start start 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 0x7fe5940c4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5941530a0 0x7fe5940c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe594153480 0x7fe59414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe594155550 con 0x7fe5940c6230 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5941560d0 con 0x7fe5941530a0 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe594156820 con 0x7fe594153480 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 0x7fe5940c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 0x7fe5940c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59756/0 (socket says 172.21.15.88:59756) 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 -- 172.21.15.88:0/2313259102 learned_addr learned my addr 172.21.15.88:0/2313259102 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.553 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe598ea1700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5941530a0 0x7fe5940c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe599ea3700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe594153480 0x7fe59414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 -- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe594153480 msgr2=0x7fe59414c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe594153480 0x7fe59414c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 -- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5941530a0 msgr2=0x7fe5940c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5941530a0 0x7fe5940c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900094b0 con 0x7fe5940c6230 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe5996a2700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 0x7fe5940c4260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe59406ff10 tx=0x7fe590004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5900036c0 con 0x7fe5940c6230 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5941557a0 con 0x7fe5940c6230 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59001f070 con 0x7fe5940c6230 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe590003a40 con 0x7fe5940c6230 2024-09-13T18:09:32.554 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe594155d60 con 0x7fe5940c6230 2024-09-13T18:09:32.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.546+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe5940ca740 con 0x7fe5940c6230 2024-09-13T18:09:32.555 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fe590003ba0 con 0x7fe5940c6230 2024-09-13T18:09:32.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe578066730 0x7fe578068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe590021070 con 0x7fe5940c6230 2024-09-13T18:09:32.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7fe57806ea50 0x7fe578070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe5780715a0 con 0x7fe57806ea50 2024-09-13T18:09:32.556 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe590086050 con 0x7fe5940c6230 2024-09-13T18:09:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe598ea1700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe578066730 0x7fe578068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe599ea3700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7fe57806ea50 0x7fe578070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe598ea1700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe578066730 0x7fe578068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe5941ec450 tx=0x7fe584009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.557 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe599ea3700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7fe57806ea50 0x7fe578070ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.558 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.550+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== osd.7 v2:172.21.15.94:6808/594133881 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fe5780715a0 con 0x7fe57806ea50 2024-09-13T18:09:32.576 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 --> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe59406d200 con 0x7fe57806ea50 2024-09-13T18:09:32.577 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe589ffb700 1 -- 172.21.15.88:0/2313259102 <== osd.7 v2:172.21.15.94:6808/594133881 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fe58c003a20 con 0x7fe57806ea50 2024-09-13T18:09:32.577 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-09-13T18:09:32.577 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-13T18:09:32.577 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7fe57806ea50 msgr2=0x7fe578070ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6808/594133881,v1:172.21.15.94:6809/594133881] conn(0x7fe57806ea50 0x7fe578070ed0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe578066730 msgr2=0x7fe578068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fe578066730 0x7fe578068bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe5941ec450 tx=0x7fe584009040 comp rx=0 tx=0).stop 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 msgr2=0x7fe5940c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.578 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 --2- 172.21.15.88:0/2313259102 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5940c6230 0x7fe5940c4260 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe59406ff10 tx=0x7fe590004770 comp rx=0 tx=0).stop 2024-09-13T18:09:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe599ea3700 1 -- 172.21.15.88:0/2313259102 reap_dead start 2024-09-13T18:09:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 shutdown_connections 2024-09-13T18:09:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 >> 172.21.15.88:0/2313259102 conn(0x7fe59406a300 msgr2=0x7fe594151c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 shutdown_connections 2024-09-13T18:09:32.579 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.570+0000 7fe59a6a4700 1 -- 172.21.15.88:0/2313259102 wait complete. 2024-09-13T18:09:32.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:09:32.707 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 Processor -- start 2024-09-13T18:09:32.708 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 -- start start 2024-09-13T18:09:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fad800cb930 0x7fad800c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fad8006fb00 0x7fad800c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad80159120 con 0x7fad800cbd10 2024-09-13T18:09:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8006e0a0 con 0x7fad8006fb00 2024-09-13T18:09:32.709 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8006d3c0 con 0x7fad800cb930 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fad800cbd10 0x7fad80152b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59564/0 (socket says 172.21.15.88:59564) 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7effd700 1 -- 172.21.15.88:0/4160302198 learned_addr learned my addr 172.21.15.88:0/4160302198 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 --2- 172.21.15.88:0/4160302198 >> v2:172.21.15.88:3300/0 conn(0x7fad8006fb00 0x7fad800c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7f7fe700 1 --2- 172.21.15.88:0/4160302198 >> v2:172.21.15.94:3300/0 conn(0x7fad800cb930 0x7fad800c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7e7fc700 1 -- 172.21.15.88:0/4160302198 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282687210 0 0) 0x7fad80159120 con 0x7fad800cbd10 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7e7fc700 1 -- 172.21.15.88:0/4160302198 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0035d0 con 0x7fad800cbd10 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 -- 172.21.15.88:0/4160302198 >> v2:172.21.15.94:3300/0 conn(0x7fad800cb930 msgr2=0x7fad800c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 --2- 172.21.15.88:0/4160302198 >> v2:172.21.15.94:3300/0 conn(0x7fad800cb930 0x7fad800c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 -- 172.21.15.88:0/4160302198 >> v1:172.21.15.88:6789/0 conn(0x7fad800cbd10 legacy=0x7fad80152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 -- 172.21.15.88:0/4160302198 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad80158e50 con 0x7fad8006fb00 2024-09-13T18:09:32.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7ffff700 1 --2- 172.21.15.88:0/4160302198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad8006fb00 0x7fad800c7440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad78009d90 tx=0x7fad7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ef9d363eb7b507 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7e7fc700 1 -- 172.21.15.88:0/4160302198 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800e070 con 0x7fad8006fb00 2024-09-13T18:09:32.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7e7fc700 1 -- 172.21.15.88:0/4160302198 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad7800bae0 con 0x7fad8006fb00 2024-09-13T18:09:32.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad7e7fc700 1 -- 172.21.15.88:0/4160302198 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7800be50 con 0x7fad8006fb00 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 -- 172.21.15.88:0/4160302198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad8006fb00 msgr2=0x7fad800c7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.702+0000 7fad848a6700 1 --2- 172.21.15.88:0/4160302198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad8006fb00 0x7fad800c7440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fad78009d90 tx=0x7fad7800b330 comp rx=0 tx=0).stop 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- 172.21.15.88:0/4160302198 shutdown_connections 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 --2- 172.21.15.88:0/4160302198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad8006fb00 0x7fad800c7440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 --2- 172.21.15.88:0/4160302198 >> v2:172.21.15.94:3300/0 conn(0x7fad800cb930 0x7fad800c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- 172.21.15.88:0/4160302198 >> 172.21.15.88:0/4160302198 conn(0x7fad800666c0 msgr2=0x7fad8006ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- 172.21.15.88:0/4160302198 shutdown_connections 2024-09-13T18:09:32.712 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- 172.21.15.88:0/4160302198 wait complete. 2024-09-13T18:09:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 Processor -- start 2024-09-13T18:09:32.713 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- start start 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad8006fb00 0x7fad80154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad800cbd10 0x7fad8015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8015a010 con 0x7fad800cb930 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad801ef060 con 0x7fad8006fb00 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad80156360 con 0x7fad800cbd10 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59786/0 (socket says 172.21.15.88:59786) 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 -- 172.21.15.88:0/3133731978 learned_addr learned my addr 172.21.15.88:0/3133731978 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7ffff700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad800cbd10 0x7fad8015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.714 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7f7fe700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad8006fb00 0x7fad80154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 -- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad800cbd10 msgr2=0x7fad8015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.715 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad800cbd10 0x7fad8015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 -- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad8006fb00 msgr2=0x7fad80154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad8006fb00 0x7fad80154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 -- 172.21.15.88:0/3133731978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad78009a70 con 0x7fad800cb930 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad7effd700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c4d0 tx=0x7fad6800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68005d90 con 0x7fad800cb930 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800ce80 con 0x7fad800cb930 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad80156640 con 0x7fad800cb930 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.706+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680072d0 con 0x7fad800cb930 2024-09-13T18:09:32.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8015a2d0 con 0x7fad800cb930 2024-09-13T18:09:32.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8015a4f0 con 0x7fad800cb930 2024-09-13T18:09:32.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fad68007430 con 0x7fad800cb930 2024-09-13T18:09:32.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad77fff700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 0x7fad60068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:32.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fad68083460 con 0x7fad800cb930 2024-09-13T18:09:32.718 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.710+0000 7fad7f7fe700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 0x7fad60068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:32.719 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.714+0000 7fad7f7fe700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 0x7fad60068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad70009bf0 tx=0x7fad70009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:32.728 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.722+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fad68050800 con 0x7fad800cb930 2024-09-13T18:09:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.890+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fad80159980 con 0x7fad60066730 2024-09-13T18:09:32.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.890+0000 7fad77fff700 1 -- 172.21.15.88:0/3133731978 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad70004020 con 0x7fad60066730 2024-09-13T18:09:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 msgr2=0x7fad60068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 0x7fad60068bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fad70009bf0 tx=0x7fad70009240 comp rx=0 tx=0).stop 2024-09-13T18:09:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 msgr2=0x7fad8015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:32.901 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fad6800c4d0 tx=0x7fad6800c7e0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 shutdown_connections 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fad60066730 0x7fad60068bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fad800cbd10 0x7fad8015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fad800cb930 0x7fad8015c620 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 --2- 172.21.15.88:0/3133731978 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fad8006fb00 0x7fad80154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 >> 172.21.15.88:0/3133731978 conn(0x7fad800666c0 msgr2=0x7fad80150590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 shutdown_connections 2024-09-13T18:09:32.902 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:32.894+0000 7fad848a6700 1 -- 172.21.15.88:0/3133731978 wait complete. 2024-09-13T18:09:32.903 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:09:32.914 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:09:33.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 Processor -- start 2024-09-13T18:09:33.027 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- start start 2024-09-13T18:09:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f801c0c73e0 0x7f801c159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c77c0 0x7f801c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.029 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801c06c3a0 con 0x7f801c070430 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f801c0c62d0 con 0x7f801c0c73e0 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c15a000 con 0x7f801c0c77c0 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f801c070430 0x7f801c06c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:59570/0 (socket says 172.21.15.88:59570) 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801bfff700 1 -- 172.21.15.88:0/3585827264 learned_addr learned my addr 172.21.15.88:0/3585827264 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 --2- 172.21.15.88:0/3585827264 >> v2:172.21.15.88:3300/0 conn(0x7f801c0c73e0 0x7f801c159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801affd700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c77c0 0x7f801c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801a7fc700 1 -- 172.21.15.88:0/3585827264 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773279924 0 0) 0x7f801c06c3a0 con 0x7f801c070430 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801a7fc700 1 -- 172.21.15.88:0/3585827264 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80080035d0 con 0x7f801c070430 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 -- 172.21.15.88:0/3585827264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c77c0 msgr2=0x7f801c152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c77c0 0x7f801c152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 -- 172.21.15.88:0/3585827264 >> v1:172.21.15.88:6789/0 conn(0x7f801c070430 legacy=0x7f801c06c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 -- 172.21.15.88:0/3585827264 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801c06f5c0 con 0x7f801c0c73e0 2024-09-13T18:09:33.030 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801b7fe700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c73e0 0x7f801c159ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f800c009d90 tx=0x7f800c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6444c0a42aa74c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801a7fc700 1 -- 172.21.15.88:0/3585827264 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00e070 con 0x7f801c0c73e0 2024-09-13T18:09:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801a7fc700 1 -- 172.21.15.88:0/3585827264 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c00bb20 con 0x7f801c0c73e0 2024-09-13T18:09:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f801a7fc700 1 -- 172.21.15.88:0/3585827264 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c00be90 con 0x7f801c0c73e0 2024-09-13T18:09:33.031 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- 172.21.15.88:0/3585827264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c73e0 msgr2=0x7f801c159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c73e0 0x7f801c159ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f800c009d90 tx=0x7f800c00b330 comp rx=0 tx=0).stop 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- 172.21.15.88:0/3585827264 shutdown_connections 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c77c0 0x7f801c152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 --2- 172.21.15.88:0/3585827264 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c0c73e0 0x7f801c159ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- 172.21.15.88:0/3585827264 >> 172.21.15.88:0/3585827264 conn(0x7f801c0cb3c0 msgr2=0x7f801c0cb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- 172.21.15.88:0/3585827264 shutdown_connections 2024-09-13T18:09:33.032 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.022+0000 7f8021f92700 1 -- 172.21.15.88:0/3585827264 wait complete. 2024-09-13T18:09:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 Processor -- start 2024-09-13T18:09:33.033 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 -- start start 2024-09-13T18:09:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 0x7f801c1ee850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f801c0c77c0 0x7f801c1eed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.036 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1f27e0 con 0x7f801c070430 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1ee390 con 0x7f801c0c77c0 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.026+0000 7f8021f92700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801c155410 con 0x7f801c0c73e0 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:59796/0 (socket says 172.21.15.88:59796) 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 -- 172.21.15.88:0/1460751634 learned_addr learned my addr 172.21.15.88:0/1460751634 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801affd700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 0x7f801c1ee850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801bfff700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f801c0c77c0 0x7f801c1eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 -- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 msgr2=0x7f801c1ee850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 0x7f801c1ee850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 -- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f801c0c77c0 msgr2=0x7f801c1eed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f801c0c77c0 0x7f801c1eed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 -- 172.21.15.88:0/1460751634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c009a70 con 0x7f801c070430 2024-09-13T18:09:33.037 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801affd700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 0x7f801c1ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f801b7fe700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b370 tx=0x7f800c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c007000 con 0x7f801c070430 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800c020070 con 0x7f801c070430 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800c0276c0 con 0x7f801c070430 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c1556f0 con 0x7f801c070430 2024-09-13T18:09:33.038 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c155cb0 con 0x7f801c070430 2024-09-13T18:09:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c06f1a0 con 0x7f801c070430 2024-09-13T18:09:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f800c027820 con 0x7f801c070430 2024-09-13T18:09:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 0x7f7ffc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.030+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f800c022070 con 0x7f801c070430 2024-09-13T18:09:33.039 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.034+0000 7f801affd700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 0x7f7ffc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:33.040 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.034+0000 7f801affd700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 0x7f7ffc068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f801c0cb910 tx=0x7f8004008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:33.044 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.038+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f800c053520 con 0x7f801c070430 2024-09-13T18:09:33.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.206+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f801c06fe60 con 0x7f7ffc066760 2024-09-13T18:09:33.231 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.226+0000 7f8013fff700 1 -- 172.21.15.88:0/1460751634 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288394 (secure 0 0 0) 0x7f8004011830 con 0x7f7ffc066760 2024-09-13T18:09:33.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 msgr2=0x7f7ffc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 0x7f7ffc068c20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f801c0cb910 tx=0x7f8004008040 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 msgr2=0x7f801c158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f800c00b370 tx=0x7f800c004af0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 shutdown_connections 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7ffc066760 0x7f7ffc068c20 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f801c0cb910 tx=0x7f8004008040 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f801c0c73e0 0x7f801c1ee850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f801c0c77c0 0x7f801c1eed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 --2- 172.21.15.88:0/1460751634 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801c070430 0x7f801c158170 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 >> 172.21.15.88:0/1460751634 conn(0x7f801c0cb3c0 msgr2=0x7f801c070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 shutdown_connections 2024-09-13T18:09:33.239 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:33.230+0000 7f8021f92700 1 -- 172.21.15.88:0/1460751634 wait complete. 2024-09-13T18:09:33.240 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:09:33.253 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-13T18:09:33.044867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10067,"ondisk_log_size":10067,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300512,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":297971,"kb_avail":754674208,"statfs":{"total":773094113280,"available":772786388992,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":305122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2228,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004606"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.244766+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:20.244766+0000","last_peered":"2024-09-13T18:09:20.244766+0000","last_clean":"2024-09-13T18:09:20.244766+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:20.244766+0000","last_undegraded":"2024-09-13T18:09:20.244766+0000","last_fullsized":"2024-09-13T18:09:20.244766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:53.408320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222537+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:09:20.222537+0000","last_peered":"2024-09-13T18:09:20.222537+0000","last_clean":"2024-09-13T18:09:20.222537+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:20.222537+0000","last_undegraded":"2024-09-13T18:09:20.222537+0000","last_fullsized":"2024-09-13T18:09:20.222537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.214676+0000","last_change":"2024-09-13T18:05:26.482942+0000","last_active":"2024-09-13T18:09:20.214676+0000","last_peered":"2024-09-13T18:09:20.214676+0000","last_clean":"2024-09-13T18:09:20.214676+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:20.214676+0000","last_undegraded":"2024-09-13T18:09:20.214676+0000","last_fullsized":"2024-09-13T18:09:20.214676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:39.287770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246619+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:20.246619+0000","last_peered":"2024-09-13T18:09:20.246619+0000","last_clean":"2024-09-13T18:09:20.246619+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:20.246619+0000","last_undegraded":"2024-09-13T18:09:20.246619+0000","last_fullsized":"2024-09-13T18:09:20.246619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:36:25.586151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234666+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:20.234666+0000","last_peered":"2024-09-13T18:09:20.234666+0000","last_clean":"2024-09-13T18:09:20.234666+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:20.234666+0000","last_undegraded":"2024-09-13T18:09:20.234666+0000","last_fullsized":"2024-09-13T18:09:20.234666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:41:42.589617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.242592+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.242592+0000","last_peered":"2024-09-13T18:09:20.242592+0000","last_clean":"2024-09-13T18:09:20.242592+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.242592+0000","last_undegraded":"2024-09-13T18:09:20.242592+0000","last_fullsized":"2024-09-13T18:09:20.242592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:59.491131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.224958+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:09:20.224958+0000","last_peered":"2024-09-13T18:09:20.224958+0000","last_clean":"2024-09-13T18:09:20.224958+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:09:20.224958+0000","last_undegraded":"2024-09-13T18:09:20.224958+0000","last_fullsized":"2024-09-13T18:09:20.224958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:50.054654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":207,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234083+0000","last_change":"2024-09-13T18:06:16.752158+0000","last_active":"2024-09-13T18:09:20.234083+0000","last_peered":"2024-09-13T18:09:20.234083+0000","last_clean":"2024-09-13T18:09:20.234083+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:20.234083+0000","last_undegraded":"2024-09-13T18:09:20.234083+0000","last_fullsized":"2024-09-13T18:09:20.234083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:39.640336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247889+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:09:20.247889+0000","last_peered":"2024-09-13T18:09:20.247889+0000","last_clean":"2024-09-13T18:09:20.247889+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:09:20.247889+0000","last_undegraded":"2024-09-13T18:09:20.247889+0000","last_fullsized":"2024-09-13T18:09:20.247889+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:38.721390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231457+0000","last_change":"2024-09-13T18:06:16.720806+0000","last_active":"2024-09-13T18:09:20.231457+0000","last_peered":"2024-09-13T18:09:20.231457+0000","last_clean":"2024-09-13T18:09:20.231457+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:20.231457+0000","last_undegraded":"2024-09-13T18:09:20.231457+0000","last_fullsized":"2024-09-13T18:09:20.231457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:35:00.555081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246616+0000","last_change":"2024-09-13T18:05:26.501653+0000","last_active":"2024-09-13T18:09:20.246616+0000","last_peered":"2024-09-13T18:09:20.246616+0000","last_clean":"2024-09-13T18:09:20.246616+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:20.246616+0000","last_undegraded":"2024-09-13T18:09:20.246616+0000","last_fullsized":"2024-09-13T18:09:20.246616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227837+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:09:20.227837+0000","last_peered":"2024-09-13T18:09:20.227837+0000","last_clean":"2024-09-13T18:09:20.227837+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:20.227837+0000","last_undegraded":"2024-09-13T18:09:20.227837+0000","last_fullsized":"2024-09-13T18:09:20.227837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:56.942558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.237119+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:09:20.237119+0000","last_peered":"2024-09-13T18:09:20.237119+0000","last_clean":"2024-09-13T18:09:20.237119+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:09:20.237119+0000","last_undegraded":"2024-09-13T18:09:20.237119+0000","last_fullsized":"2024-09-13T18:09:20.237119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222864+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:09:20.222864+0000","last_peered":"2024-09-13T18:09:20.222864+0000","last_clean":"2024-09-13T18:09:20.222864+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:20.222864+0000","last_undegraded":"2024-09-13T18:09:20.222864+0000","last_fullsized":"2024-09-13T18:09:20.222864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:36:29.362569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.226082+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:09:20.226082+0000","last_peered":"2024-09-13T18:09:20.226082+0000","last_clean":"2024-09-13T18:09:20.226082+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:20.226082+0000","last_undegraded":"2024-09-13T18:09:20.226082+0000","last_fullsized":"2024-09-13T18:09:20.226082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239166+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:09:20.239166+0000","last_peered":"2024-09-13T18:09:20.239166+0000","last_clean":"2024-09-13T18:09:20.239166+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:20.239166+0000","last_undegraded":"2024-09-13T18:09:20.239166+0000","last_fullsized":"2024-09-13T18:09:20.239166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246407+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:09:20.246407+0000","last_peered":"2024-09-13T18:09:20.246407+0000","last_clean":"2024-09-13T18:09:20.246407+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:20.246407+0000","last_undegraded":"2024-09-13T18:09:20.246407+0000","last_fullsized":"2024-09-13T18:09:20.246407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:33:57.895609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235176+0000","last_change":"2024-09-13T18:05:26.500873+0000","last_active":"2024-09-13T18:09:20.235176+0000","last_peered":"2024-09-13T18:09:20.235176+0000","last_clean":"2024-09-13T18:09:20.235176+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:20.235176+0000","last_undegraded":"2024-09-13T18:09:20.235176+0000","last_fullsized":"2024-09-13T18:09:20.235176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227939+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:20.227939+0000","last_peered":"2024-09-13T18:09:20.227939+0000","last_clean":"2024-09-13T18:09:20.227939+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:20.227939+0000","last_undegraded":"2024-09-13T18:09:20.227939+0000","last_fullsized":"2024-09-13T18:09:20.227939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:33.987520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228172+0000","last_change":"2024-09-13T18:05:26.494427+0000","last_active":"2024-09-13T18:09:20.228172+0000","last_peered":"2024-09-13T18:09:20.228172+0000","last_clean":"2024-09-13T18:09:20.228172+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:20.228172+0000","last_undegraded":"2024-09-13T18:09:20.228172+0000","last_fullsized":"2024-09-13T18:09:20.228172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229849+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:09:20.229849+0000","last_peered":"2024-09-13T18:09:20.229849+0000","last_clean":"2024-09-13T18:09:20.229849+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:20.229849+0000","last_undegraded":"2024-09-13T18:09:20.229849+0000","last_fullsized":"2024-09-13T18:09:20.229849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245252+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:09:20.245252+0000","last_peered":"2024-09-13T18:09:20.245252+0000","last_clean":"2024-09-13T18:09:20.245252+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:09:20.245252+0000","last_undegraded":"2024-09-13T18:09:20.245252+0000","last_fullsized":"2024-09-13T18:09:20.245252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:50.781555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230542+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:09:20.230542+0000","last_peered":"2024-09-13T18:09:20.230542+0000","last_clean":"2024-09-13T18:09:20.230542+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:20.230542+0000","last_undegraded":"2024-09-13T18:09:20.230542+0000","last_fullsized":"2024-09-13T18:09:20.230542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":193,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239102+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:09:20.239102+0000","last_peered":"2024-09-13T18:09:20.239102+0000","last_clean":"2024-09-13T18:09:20.239102+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:20.239102+0000","last_undegraded":"2024-09-13T18:09:20.239102+0000","last_fullsized":"2024-09-13T18:09:20.239102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:29.528511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230200+0000","last_change":"2024-09-13T18:05:26.490218+0000","last_active":"2024-09-13T18:09:20.230200+0000","last_peered":"2024-09-13T18:09:20.230200+0000","last_clean":"2024-09-13T18:09:20.230200+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:20.230200+0000","last_undegraded":"2024-09-13T18:09:20.230200+0000","last_fullsized":"2024-09-13T18:09:20.230200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:14:02.111715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":211,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233195+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:09:20.233195+0000","last_peered":"2024-09-13T18:09:20.233195+0000","last_clean":"2024-09-13T18:09:20.233195+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:20.233195+0000","last_undegraded":"2024-09-13T18:09:20.233195+0000","last_fullsized":"2024-09-13T18:09:20.233195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:36.651481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231236+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:09:20.231236+0000","last_peered":"2024-09-13T18:09:20.231236+0000","last_clean":"2024-09-13T18:09:20.231236+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:20.231236+0000","last_undegraded":"2024-09-13T18:09:20.231236+0000","last_fullsized":"2024-09-13T18:09:20.231236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":146,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232446+0000","last_change":"2024-09-13T18:05:26.488927+0000","last_active":"2024-09-13T18:09:20.232446+0000","last_peered":"2024-09-13T18:09:20.232446+0000","last_clean":"2024-09-13T18:09:20.232446+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:20.232446+0000","last_undegraded":"2024-09-13T18:09:20.232446+0000","last_fullsized":"2024-09-13T18:09:20.232446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:21:36.773138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":131,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235269+0000","last_change":"2024-09-13T18:05:26.492104+0000","last_active":"2024-09-13T18:09:20.235269+0000","last_peered":"2024-09-13T18:09:20.235269+0000","last_clean":"2024-09-13T18:09:20.235269+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:20.235269+0000","last_undegraded":"2024-09-13T18:09:20.235269+0000","last_fullsized":"2024-09-13T18:09:20.235269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:05:08.962594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231767+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:09:20.231767+0000","last_peered":"2024-09-13T18:09:20.231767+0000","last_clean":"2024-09-13T18:09:20.231767+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:20.231767+0000","last_undegraded":"2024-09-13T18:09:20.231767+0000","last_fullsized":"2024-09-13T18:09:20.231767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:36:03.592938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":149,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239852+0000","last_change":"2024-09-13T18:05:26.486043+0000","last_active":"2024-09-13T18:09:20.239852+0000","last_peered":"2024-09-13T18:09:20.239852+0000","last_clean":"2024-09-13T18:09:20.239852+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:20.239852+0000","last_undegraded":"2024-09-13T18:09:20.239852+0000","last_fullsized":"2024-09-13T18:09:20.239852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228817+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:09:20.228817+0000","last_peered":"2024-09-13T18:09:20.228817+0000","last_clean":"2024-09-13T18:09:20.228817+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:20.228817+0000","last_undegraded":"2024-09-13T18:09:20.228817+0000","last_fullsized":"2024-09-13T18:09:20.228817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:43:11.896529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":143,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.223691+0000","last_change":"2024-09-13T18:05:26.486559+0000","last_active":"2024-09-13T18:09:20.223691+0000","last_peered":"2024-09-13T18:09:20.223691+0000","last_clean":"2024-09-13T18:09:20.223691+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:20.223691+0000","last_undegraded":"2024-09-13T18:09:20.223691+0000","last_fullsized":"2024-09-13T18:09:20.223691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:23.695301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'7","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:08:00.056573+0000","last_change":"2024-09-13T18:05:26.124305+0000","last_active":"2024-09-13T18:08:00.056573+0000","last_peered":"2024-09-13T18:08:00.056573+0000","last_clean":"2024-09-13T18:08:00.056573+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:08:00.056573+0000","last_undegraded":"2024-09-13T18:08:00.056573+0000","last_fullsized":"2024-09-13T18:08:00.056573+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:28.980931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229461+0000","last_change":"2024-09-13T18:05:26.479849+0000","last_active":"2024-09-13T18:09:20.229461+0000","last_peered":"2024-09-13T18:09:20.229461+0000","last_clean":"2024-09-13T18:09:20.229461+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:20.229461+0000","last_undegraded":"2024-09-13T18:09:20.229461+0000","last_fullsized":"2024-09-13T18:09:20.229461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:26.916276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.716994+0000","last_change":"2024-09-13T18:05:26.107272+0000","last_active":"2024-09-13T18:06:16.716994+0000","last_peered":"2024-09-13T18:06:16.716994+0000","last_clean":"2024-09-13T18:06:16.716994+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:06:16.716994+0000","last_undegraded":"2024-09-13T18:06:16.716994+0000","last_fullsized":"2024-09-13T18:06:16.716994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.713078+0000","last_change":"2024-09-13T18:05:26.118451+0000","last_active":"2024-09-13T18:06:16.713078+0000","last_peered":"2024-09-13T18:06:16.713078+0000","last_clean":"2024-09-13T18:06:16.713078+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:06:16.713078+0000","last_undegraded":"2024-09-13T18:06:16.713078+0000","last_fullsized":"2024-09-13T18:06:16.713078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:24.385500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233805+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:09:20.233805+0000","last_peered":"2024-09-13T18:09:20.233805+0000","last_clean":"2024-09-13T18:09:20.233805+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:20.233805+0000","last_undegraded":"2024-09-13T18:09:20.233805+0000","last_fullsized":"2024-09-13T18:09:20.233805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:12:52.652294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222469+0000","last_change":"2024-09-13T18:05:26.108898+0000","last_active":"2024-09-13T18:06:17.222469+0000","last_peered":"2024-09-13T18:06:17.222469+0000","last_clean":"2024-09-13T18:06:17.222469+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:06:17.222469+0000","last_undegraded":"2024-09-13T18:06:17.222469+0000","last_fullsized":"2024-09-13T18:06:17.222469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:44.069663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231525+0000","last_change":"2024-09-13T18:05:26.490413+0000","last_active":"2024-09-13T18:09:20.231525+0000","last_peered":"2024-09-13T18:09:20.231525+0000","last_clean":"2024-09-13T18:09:20.231525+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:20.231525+0000","last_undegraded":"2024-09-13T18:09:20.231525+0000","last_fullsized":"2024-09-13T18:09:20.231525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:55.052228+0000","last_change":"2024-09-13T18:05:26.109297+0000","last_active":"2024-09-13T18:07:55.052228+0000","last_peered":"2024-09-13T18:07:55.052228+0000","last_clean":"2024-09-13T18:07:55.052228+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:07:55.052228+0000","last_undegraded":"2024-09-13T18:07:55.052228+0000","last_fullsized":"2024-09-13T18:07:55.052228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:57:41.145400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":242,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246708+0000","last_change":"2024-09-13T18:05:26.493964+0000","last_active":"2024-09-13T18:09:20.246708+0000","last_peered":"2024-09-13T18:09:20.246708+0000","last_clean":"2024-09-13T18:09:20.246708+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:20.246708+0000","last_undegraded":"2024-09-13T18:09:20.246708+0000","last_fullsized":"2024-09-13T18:09:20.246708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:21:36.367397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223568+0000","last_change":"2024-09-13T18:05:26.112679+0000","last_active":"2024-09-13T18:06:17.223568+0000","last_peered":"2024-09-13T18:06:17.223568+0000","last_clean":"2024-09-13T18:06:17.223568+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:06:17.223568+0000","last_undegraded":"2024-09-13T18:06:17.223568+0000","last_fullsized":"2024-09-13T18:06:17.223568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241669+0000","last_change":"2024-09-13T18:05:26.503840+0000","last_active":"2024-09-13T18:09:20.241669+0000","last_peered":"2024-09-13T18:09:20.241669+0000","last_clean":"2024-09-13T18:09:20.241669+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:20.241669+0000","last_undegraded":"2024-09-13T18:09:20.241669+0000","last_fullsized":"2024-09-13T18:09:20.241669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:19:26.827248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'10","reported_seq":25,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.713511+0000","last_change":"2024-09-13T18:05:26.112802+0000","last_active":"2024-09-13T18:09:18.713511+0000","last_peered":"2024-09-13T18:09:18.713511+0000","last_clean":"2024-09-13T18:09:18.713511+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:18.713511+0000","last_undegraded":"2024-09-13T18:09:18.713511+0000","last_fullsized":"2024-09-13T18:09:18.713511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236337+0000","last_change":"2024-09-13T18:05:26.485960+0000","last_active":"2024-09-13T18:09:20.236337+0000","last_peered":"2024-09-13T18:09:20.236337+0000","last_clean":"2024-09-13T18:09:20.236337+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:20.236337+0000","last_undegraded":"2024-09-13T18:09:20.236337+0000","last_fullsized":"2024-09-13T18:09:20.236337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:34.238626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'95","reported_seq":109,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.249817+0000","last_change":"2024-09-13T18:05:26.118057+0000","last_active":"2024-09-13T18:09:20.249817+0000","last_peered":"2024-09-13T18:09:20.249817+0000","last_clean":"2024-09-13T18:09:20.249817+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:20.249817+0000","last_undegraded":"2024-09-13T18:09:20.249817+0000","last_fullsized":"2024-09-13T18:09:20.249817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231850+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:09:20.231850+0000","last_peered":"2024-09-13T18:09:20.231850+0000","last_clean":"2024-09-13T18:09:20.231850+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:09:20.231850+0000","last_undegraded":"2024-09-13T18:09:20.231850+0000","last_fullsized":"2024-09-13T18:09:20.231850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:31:54.101065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223524+0000","last_change":"2024-09-13T18:05:26.114409+0000","last_active":"2024-09-13T18:06:17.223524+0000","last_peered":"2024-09-13T18:06:17.223524+0000","last_clean":"2024-09-13T18:06:17.223524+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:06:17.223524+0000","last_undegraded":"2024-09-13T18:06:17.223524+0000","last_fullsized":"2024-09-13T18:06:17.223524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:16.368648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227524+0000","last_change":"2024-09-13T18:06:17.149866+0000","last_active":"2024-09-13T18:09:20.227524+0000","last_peered":"2024-09-13T18:09:20.227524+0000","last_clean":"2024-09-13T18:09:20.227524+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:20.227524+0000","last_undegraded":"2024-09-13T18:09:20.227524+0000","last_fullsized":"2024-09-13T18:09:20.227524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223854+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:06:17.223854+0000","last_peered":"2024-09-13T18:06:17.223854+0000","last_clean":"2024-09-13T18:06:17.223854+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:06:17.223854+0000","last_undegraded":"2024-09-13T18:06:17.223854+0000","last_fullsized":"2024-09-13T18:06:17.223854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:26.945366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239477+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:09:20.239477+0000","last_peered":"2024-09-13T18:09:20.239477+0000","last_clean":"2024-09-13T18:09:20.239477+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:20.239477+0000","last_undegraded":"2024-09-13T18:09:20.239477+0000","last_fullsized":"2024-09-13T18:09:20.239477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:51.849012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:16.717003+0000","last_change":"2024-09-13T18:05:26.106572+0000","last_active":"2024-09-13T18:06:16.717003+0000","last_peered":"2024-09-13T18:06:16.717003+0000","last_clean":"2024-09-13T18:06:16.717003+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:06:16.717003+0000","last_undegraded":"2024-09-13T18:06:16.717003+0000","last_fullsized":"2024-09-13T18:06:16.717003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:35:14.259563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221064+0000","last_change":"2024-09-13T18:05:26.495160+0000","last_active":"2024-09-13T18:09:20.221064+0000","last_peered":"2024-09-13T18:09:20.221064+0000","last_clean":"2024-09-13T18:09:20.221064+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:20.221064+0000","last_undegraded":"2024-09-13T18:09:20.221064+0000","last_fullsized":"2024-09-13T18:09:20.221064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:58.673221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'16","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.710617+0000","last_change":"2024-09-13T18:05:26.112517+0000","last_active":"2024-09-13T18:09:18.710617+0000","last_peered":"2024-09-13T18:09:18.710617+0000","last_clean":"2024-09-13T18:09:18.710617+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:09:18.710617+0000","last_undegraded":"2024-09-13T18:09:18.710617+0000","last_fullsized":"2024-09-13T18:09:18.710617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":202,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232146+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:09:20.232146+0000","last_peered":"2024-09-13T18:09:20.232146+0000","last_clean":"2024-09-13T18:09:20.232146+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:20.232146+0000","last_undegraded":"2024-09-13T18:09:20.232146+0000","last_fullsized":"2024-09-13T18:09:20.232146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:59.682725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.225545+0000","last_change":"2024-09-13T18:05:26.109174+0000","last_active":"2024-09-13T18:06:17.225545+0000","last_peered":"2024-09-13T18:06:17.225545+0000","last_clean":"2024-09-13T18:06:17.225545+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:06:17.225545+0000","last_undegraded":"2024-09-13T18:06:17.225545+0000","last_fullsized":"2024-09-13T18:06:17.225545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:24:00.090522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231559+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:09:20.231559+0000","last_peered":"2024-09-13T18:09:20.231559+0000","last_clean":"2024-09-13T18:09:20.231559+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:20.231559+0000","last_undegraded":"2024-09-13T18:09:20.231559+0000","last_fullsized":"2024-09-13T18:09:20.231559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:36:34.818724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:41.050037+0000","last_change":"2024-09-13T18:05:26.113226+0000","last_active":"2024-09-13T18:07:41.050037+0000","last_peered":"2024-09-13T18:07:41.050037+0000","last_clean":"2024-09-13T18:07:41.050037+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:07:41.050037+0000","last_undegraded":"2024-09-13T18:07:41.050037+0000","last_fullsized":"2024-09-13T18:07:41.050037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.247445+0000","last_change":"2024-09-13T18:05:26.481837+0000","last_active":"2024-09-13T18:09:20.247445+0000","last_peered":"2024-09-13T18:09:20.247445+0000","last_clean":"2024-09-13T18:09:20.247445+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:20.247445+0000","last_undegraded":"2024-09-13T18:09:20.247445+0000","last_fullsized":"2024-09-13T18:09:20.247445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:53.934945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:41.051638+0000","last_change":"2024-09-13T18:05:26.111151+0000","last_active":"2024-09-13T18:07:41.051638+0000","last_peered":"2024-09-13T18:07:41.051638+0000","last_clean":"2024-09-13T18:07:41.051638+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:07:41.051638+0000","last_undegraded":"2024-09-13T18:07:41.051638+0000","last_fullsized":"2024-09-13T18:07:41.051638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222327+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:20.222327+0000","last_peered":"2024-09-13T18:09:20.222327+0000","last_clean":"2024-09-13T18:09:20.222327+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:20.222327+0000","last_undegraded":"2024-09-13T18:09:20.222327+0000","last_fullsized":"2024-09-13T18:09:20.222327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:20.206497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"20'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:41.049980+0000","last_change":"2024-09-13T18:05:26.120046+0000","last_active":"2024-09-13T18:07:41.049980+0000","last_peered":"2024-09-13T18:07:41.049980+0000","last_clean":"2024-09-13T18:07:41.049980+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:07:41.049980+0000","last_undegraded":"2024-09-13T18:07:41.049980+0000","last_fullsized":"2024-09-13T18:07:41.049980+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240140+0000","last_change":"2024-09-13T18:05:26.502027+0000","last_active":"2024-09-13T18:09:20.240140+0000","last_peered":"2024-09-13T18:09:20.240140+0000","last_clean":"2024-09-13T18:09:20.240140+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:20.240140+0000","last_undegraded":"2024-09-13T18:09:20.240140+0000","last_fullsized":"2024-09-13T18:09:20.240140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:00.842078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:20.054603+0000","last_change":"2024-09-13T18:05:20.877893+0000","last_active":"2024-09-13T18:07:20.054603+0000","last_peered":"2024-09-13T18:07:20.054603+0000","last_clean":"2024-09-13T18:07:20.054603+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:07:20.054603+0000","last_undegraded":"2024-09-13T18:07:20.054603+0000","last_fullsized":"2024-09-13T18:07:20.054603+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:19.049215+0000","last_clean_scrub_stamp":"2024-09-13T18:05:19.049215+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:44.897478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.222824+0000","last_change":"2024-09-13T18:05:26.108161+0000","last_active":"2024-09-13T18:06:17.222824+0000","last_peered":"2024-09-13T18:06:17.222824+0000","last_clean":"2024-09-13T18:06:17.222824+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:06:17.222824+0000","last_undegraded":"2024-09-13T18:06:17.222824+0000","last_fullsized":"2024-09-13T18:06:17.222824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:14:31.014849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239991+0000","last_change":"2024-09-13T18:06:17.227202+0000","last_active":"2024-09-13T18:09:20.239991+0000","last_peered":"2024-09-13T18:09:20.239991+0000","last_clean":"2024-09-13T18:09:20.239991+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:20.239991+0000","last_undegraded":"2024-09-13T18:09:20.239991+0000","last_fullsized":"2024-09-13T18:09:20.239991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"20'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:30.056750+0000","last_change":"2024-09-13T18:05:26.119385+0000","last_active":"2024-09-13T18:07:30.056750+0000","last_peered":"2024-09-13T18:07:30.056750+0000","last_clean":"2024-09-13T18:07:30.056750+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:07:30.056750+0000","last_undegraded":"2024-09-13T18:07:30.056750+0000","last_fullsized":"2024-09-13T18:07:30.056750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:26:32.893779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229227+0000","last_change":"2024-09-13T18:05:26.483927+0000","last_active":"2024-09-13T18:09:20.229227+0000","last_peered":"2024-09-13T18:09:20.229227+0000","last_clean":"2024-09-13T18:09:20.229227+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:20.229227+0000","last_undegraded":"2024-09-13T18:09:20.229227+0000","last_fullsized":"2024-09-13T18:09:20.229227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:37:37.748578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'10","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:18.708078+0000","last_change":"2024-09-13T18:05:26.119114+0000","last_active":"2024-09-13T18:09:18.708078+0000","last_peered":"2024-09-13T18:09:18.708078+0000","last_clean":"2024-09-13T18:09:18.708078+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:18.708078+0000","last_undegraded":"2024-09-13T18:09:18.708078+0000","last_fullsized":"2024-09-13T18:09:18.708078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":146,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:29.935936+0000","last_change":"2024-09-13T18:05:26.488680+0000","last_active":"2024-09-13T18:09:29.935936+0000","last_peered":"2024-09-13T18:09:29.935936+0000","last_clean":"2024-09-13T18:09:29.935936+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:29.935936+0000","last_undegraded":"2024-09-13T18:09:29.935936+0000","last_fullsized":"2024-09-13T18:09:29.935936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223846+0000","last_change":"2024-09-13T18:05:26.116384+0000","last_active":"2024-09-13T18:06:17.223846+0000","last_peered":"2024-09-13T18:06:17.223846+0000","last_clean":"2024-09-13T18:06:17.223846+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:06:17.223846+0000","last_undegraded":"2024-09-13T18:06:17.223846+0000","last_fullsized":"2024-09-13T18:06:17.223846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:21.754735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227385+0000","last_change":"2024-09-13T18:05:26.481405+0000","last_active":"2024-09-13T18:09:20.227385+0000","last_peered":"2024-09-13T18:09:20.227385+0000","last_clean":"2024-09-13T18:09:20.227385+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:20.227385+0000","last_undegraded":"2024-09-13T18:09:20.227385+0000","last_fullsized":"2024-09-13T18:09:20.227385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:43.978487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:31.049946+0000","last_change":"2024-09-13T18:05:26.112974+0000","last_active":"2024-09-13T18:07:31.049946+0000","last_peered":"2024-09-13T18:07:31.049946+0000","last_clean":"2024-09-13T18:07:31.049946+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:07:31.049946+0000","last_undegraded":"2024-09-13T18:07:31.049946+0000","last_fullsized":"2024-09-13T18:07:31.049946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240024+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:09:20.240024+0000","last_peered":"2024-09-13T18:09:20.240024+0000","last_clean":"2024-09-13T18:09:20.240024+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:20.240024+0000","last_undegraded":"2024-09-13T18:09:20.240024+0000","last_fullsized":"2024-09-13T18:09:20.240024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:16.429344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"20'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.147552+0000","last_change":"2024-09-13T18:05:26.119597+0000","last_active":"2024-09-13T18:06:17.147552+0000","last_peered":"2024-09-13T18:06:17.147552+0000","last_clean":"2024-09-13T18:06:17.147552+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:06:17.147552+0000","last_undegraded":"2024-09-13T18:06:17.147552+0000","last_fullsized":"2024-09-13T18:06:17.147552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:32:55.934631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.219161+0000","last_change":"2024-09-13T18:05:26.488866+0000","last_active":"2024-09-13T18:09:20.219161+0000","last_peered":"2024-09-13T18:09:20.219161+0000","last_clean":"2024-09-13T18:09:20.219161+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:20.219161+0000","last_undegraded":"2024-09-13T18:09:20.219161+0000","last_fullsized":"2024-09-13T18:09:20.219161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'18","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:21.510172+0000","last_change":"2024-09-13T18:05:26.111655+0000","last_active":"2024-09-13T18:09:21.510172+0000","last_peered":"2024-09-13T18:09:21.510172+0000","last_clean":"2024-09-13T18:09:21.510172+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:21.510172+0000","last_undegraded":"2024-09-13T18:09:21.510172+0000","last_fullsized":"2024-09-13T18:09:21.510172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.240595+0000","last_change":"2024-09-13T18:05:26.487956+0000","last_active":"2024-09-13T18:09:20.240595+0000","last_peered":"2024-09-13T18:09:20.240595+0000","last_clean":"2024-09-13T18:09:20.240595+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:20.240595+0000","last_undegraded":"2024-09-13T18:09:20.240595+0000","last_fullsized":"2024-09-13T18:09:20.240595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:39.823341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:40.049606+0000","last_change":"2024-09-13T18:05:26.120412+0000","last_active":"2024-09-13T18:07:40.049606+0000","last_peered":"2024-09-13T18:07:40.049606+0000","last_clean":"2024-09-13T18:07:40.049606+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:07:40.049606+0000","last_undegraded":"2024-09-13T18:07:40.049606+0000","last_fullsized":"2024-09-13T18:07:40.049606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.221838+0000","last_change":"2024-09-13T18:05:26.487133+0000","last_active":"2024-09-13T18:09:20.221838+0000","last_peered":"2024-09-13T18:09:20.221838+0000","last_clean":"2024-09-13T18:09:20.221838+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:20.221838+0000","last_undegraded":"2024-09-13T18:09:20.221838+0000","last_fullsized":"2024-09-13T18:09:20.221838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:28.767372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146357+0000","last_change":"2024-09-13T18:05:26.119595+0000","last_active":"2024-09-13T18:06:17.146357+0000","last_peered":"2024-09-13T18:06:17.146357+0000","last_clean":"2024-09-13T18:06:17.146357+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:06:17.146357+0000","last_undegraded":"2024-09-13T18:06:17.146357+0000","last_fullsized":"2024-09-13T18:06:17.146357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:20:42.970560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":147,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.196059+0000","last_change":"2024-09-13T18:05:26.480753+0000","last_active":"2024-09-13T18:09:20.196059+0000","last_peered":"2024-09-13T18:09:20.196059+0000","last_clean":"2024-09-13T18:09:20.196059+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:20.196059+0000","last_undegraded":"2024-09-13T18:09:20.196059+0000","last_fullsized":"2024-09-13T18:09:20.196059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:14.840580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'5","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.194466+0000","last_change":"2024-09-13T18:09:30.194698+0000","last_active":"2024-09-13T18:09:30.194466+0000","last_peered":"2024-09-13T18:09:30.194466+0000","last_clean":"2024-09-13T18:09:30.194466+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:09:30.194466+0000","last_undegraded":"2024-09-13T18:09:30.194466+0000","last_fullsized":"2024-09-13T18:09:30.194466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.194421+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.647061+0000","scrub_duration":0.0066843090000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.232322+0000","last_change":"2024-09-13T18:05:26.489015+0000","last_active":"2024-09-13T18:09:20.232322+0000","last_peered":"2024-09-13T18:09:20.232322+0000","last_clean":"2024-09-13T18:09:20.232322+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:20.232322+0000","last_undegraded":"2024-09-13T18:09:20.232322+0000","last_fullsized":"2024-09-13T18:09:20.232322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:21:33.638085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"20'1","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:36.050645+0000","last_change":"2024-09-13T18:05:26.116240+0000","last_active":"2024-09-13T18:07:36.050645+0000","last_peered":"2024-09-13T18:07:36.050645+0000","last_clean":"2024-09-13T18:07:36.050645+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:07:36.050645+0000","last_undegraded":"2024-09-13T18:07:36.050645+0000","last_fullsized":"2024-09-13T18:07:36.050645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.236736+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:09:20.236736+0000","last_peered":"2024-09-13T18:09:20.236736+0000","last_clean":"2024-09-13T18:09:20.236736+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:20.236736+0000","last_undegraded":"2024-09-13T18:09:20.236736+0000","last_fullsized":"2024-09-13T18:09:20.236736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:45.060694+0000","last_change":"2024-09-13T18:05:26.116126+0000","last_active":"2024-09-13T18:07:45.060694+0000","last_peered":"2024-09-13T18:07:45.060694+0000","last_clean":"2024-09-13T18:07:45.060694+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:07:45.060694+0000","last_undegraded":"2024-09-13T18:07:45.060694+0000","last_fullsized":"2024-09-13T18:07:45.060694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:13.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":141,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228017+0000","last_change":"2024-09-13T18:05:26.497106+0000","last_active":"2024-09-13T18:09:20.228017+0000","last_peered":"2024-09-13T18:09:20.228017+0000","last_clean":"2024-09-13T18:09:20.228017+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:20.228017+0000","last_undegraded":"2024-09-13T18:09:20.228017+0000","last_fullsized":"2024-09-13T18:09:20.228017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:55:10.803218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245337+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:09:20.245337+0000","last_peered":"2024-09-13T18:09:20.245337+0000","last_clean":"2024-09-13T18:09:20.245337+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:09:20.245337+0000","last_undegraded":"2024-09-13T18:09:20.245337+0000","last_fullsized":"2024-09-13T18:09:20.245337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.185401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.146813+0000","last_change":"2024-09-13T18:05:26.118838+0000","last_active":"2024-09-13T18:06:17.146813+0000","last_peered":"2024-09-13T18:06:17.146813+0000","last_clean":"2024-09-13T18:06:17.146813+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:06:17.146813+0000","last_undegraded":"2024-09-13T18:06:17.146813+0000","last_fullsized":"2024-09-13T18:06:17.146813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:33.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245976+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.245976+0000","last_peered":"2024-09-13T18:09:20.245976+0000","last_clean":"2024-09-13T18:09:20.245976+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.245976+0000","last_undegraded":"2024-09-13T18:09:20.245976+0000","last_fullsized":"2024-09-13T18:09:20.245976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:05:00.966193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":19,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:53.633949+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:07:53.633949+0000","last_peered":"2024-09-13T18:07:53.633949+0000","last_clean":"2024-09-13T18:07:53.633949+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:07:53.633949+0000","last_undegraded":"2024-09-13T18:07:53.633949+0000","last_fullsized":"2024-09-13T18:07:53.633949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:22.687373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.241744+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:09:20.241744+0000","last_peered":"2024-09-13T18:09:20.241744+0000","last_clean":"2024-09-13T18:09:20.241744+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:20.241744+0000","last_undegraded":"2024-09-13T18:09:20.241744+0000","last_fullsized":"2024-09-13T18:09:20.241744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:00.225923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:30.051274+0000","last_change":"2024-09-13T18:05:26.117740+0000","last_active":"2024-09-13T18:07:30.051274+0000","last_peered":"2024-09-13T18:07:30.051274+0000","last_clean":"2024-09-13T18:07:30.051274+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:07:30.051274+0000","last_undegraded":"2024-09-13T18:07:30.051274+0000","last_fullsized":"2024-09-13T18:07:30.051274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:47.198954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.233974+0000","last_change":"2024-09-13T18:05:26.500641+0000","last_active":"2024-09-13T18:09:20.233974+0000","last_peered":"2024-09-13T18:09:20.233974+0000","last_clean":"2024-09-13T18:09:20.233974+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:20.233974+0000","last_undegraded":"2024-09-13T18:09:20.233974+0000","last_fullsized":"2024-09-13T18:09:20.233974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:59.551204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'9","reported_seq":23,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:06:17.223509+0000","last_change":"2024-09-13T18:05:26.124508+0000","last_active":"2024-09-13T18:06:17.223509+0000","last_peered":"2024-09-13T18:06:17.223509+0000","last_clean":"2024-09-13T18:06:17.223509+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:06:17.223509+0000","last_undegraded":"2024-09-13T18:06:17.223509+0000","last_fullsized":"2024-09-13T18:06:17.223509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:50:35.859511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.65800000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.99099999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.73999999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.76300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.139,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.96199999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1120000000000001,"5min":1.516,"15min":1.516},"last":0.91700000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.499},"max":{"1min":3.7919999999999998,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.012,"5min":0.96699999999999997,"15min":1.0129999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.0669999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2330000000000001,"5min":1.907,"15min":1.907},"last":1.03},{"interface":"front","average":{"1min":1.135,"5min":1.048,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.998,"15min":1.077},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4279999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.133},{"interface":"front","average":{"1min":1.167,"5min":1.024,"15min":1.05},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.4539999999999997,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":1.0980000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509494,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.66200000000000003},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.73999999999999999,"5min":2.077,"15min":2.077},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":11.384,"5min":11.384,"15min":11.384},"last":0.59199999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.749},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.753}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4590000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.93799999999999994,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.181,"5min":1.347,"15min":1.347},"last":0.99299999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.319,"5min":1.452,"15min":1.452},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.2150000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.006,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1990000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.222,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.2849999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.377,"5min":1.46,"15min":1.46},"last":1.246},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.3300000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.232,"15min":1.232},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.91000000000000003,"15min":1.0369999999999999},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.49,"5min":6.093,"15min":6.093},"last":0.78400000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.0169999999999999,"15min":1.1479999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5349999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.038}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.149,"5min":1.0509999999999999,"15min":1.161},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.0680000000000001,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.97599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":0.90100000000000002,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.435,"15min":0.435},"max":{"1min":5.798,"5min":5.798,"15min":5.798},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.264,"5min":0.99199999999999999,"15min":0.98399999999999999},"min":{"1min":0.58599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7670000000000003,"5min":5.7670000000000003,"15min":5.7670000000000003},"last":0.753}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94599999999999995,"15min":0.97799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3420000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.25,"5min":1.161,"15min":1.2729999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.8230000000000004,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1519999999999999,"15min":1.252},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9470000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":1.143},{"interface":"front","average":{"1min":1.236,"5min":1.1830000000000001,"15min":1.2869999999999999},"min":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.8440000000000003,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":1.091}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2949999999999999,"15min":1.4450000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7359999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.123,"15min":1.2110000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":5.8689999999999998,"5min":5.8689999999999998,"15min":5.8689999999999998},"last":1.2849999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.91000000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.623}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.23,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":1.0940000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.90400000000000003,"15min":0.95199999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2789999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":1.069}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5329999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0589999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.048,"5min":1.097,"15min":1.1259999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.552,"5min":1.621,"15min":1.621},"last":0.82699999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542197,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0940000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.82199999999999995,"15min":0.879},"min":{"1min":0.44800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93700000000000006,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.70599999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.075,"5min":3.194,"15min":3.194},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.599,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91100000000000003,"15min":0.95499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6000000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.745},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.65600000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6279999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.93600000000000005,"15min":0.97499999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1859999999999999,"5min":3.125,"15min":3.125},"last":0.81000000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.91500000000000004,"15min":1.002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1930000000000001,"5min":1.909,"15min":1.909},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0509999999999999,"15min":1.105},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.679,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.099}]},{"osd":6,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98299999999999998,"15min":1.0429999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.872,"5min":1.0069999999999999,"15min":1.075},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2410000000000001,"5min":1.885,"15min":1.885},"last":0.94599999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.083,"15min":1.149},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0760000000000001,"15min":1.165},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3560000000000001,"5min":1.851,"15min":1.851},"last":0.97099999999999997}]}]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.62,"15min":0.63400000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.7349999999999999,"5min":2.7349999999999999,"15min":2.7349999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.27600000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.0189999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.629}]},{"osd":1,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.67600000000000005,"15min":0.68100000000000005},"min":{"1min":0.31900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":0.86399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.73199999999999998,"15min":0.73799999999999999},"min":{"1min":0.39000000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8130000000000002,"5min":2.8130000000000002,"15min":2.8130000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72399999999999998,"15min":0.75700000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.99299999999999999,"5min":1.798,"15min":1.798},"last":0.68400000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.86599999999999999,"15min":0.88600000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.97899999999999998,"15min":1.0089999999999999},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":3.0750000000000002,"5min":3.0750000000000002,"15min":3.0750000000000002},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.93200000000000005,"15min":0.97199999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0669999999999999,"5min":1.905,"15min":1.905},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.93000000000000005,"15min":0.95499999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.0609999999999999,"15min":1.0880000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.0189999999999999,"15min":1.0609999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.5369999999999999,"5min":1.974,"15min":1.974},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":1.008,"15min":1.04},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.3799999999999999,"5min":1.444,"15min":1.444},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.083,"15min":1.095},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":3.024,"5min":3.024,"15min":3.024},"last":1.1950000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.626}]},{"osd":1,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.84599999999999997,"15min":0.83399999999999996},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2879999999999998,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.90400000000000003,"15min":0.95399999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.121,"5min":1.173,"15min":1.173},"last":1.0660000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:08:26 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.81599999999999995,"15min":0.82999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0720000000000001,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.82499999999999996,"15min":0.83899999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.75}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.101}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.0069999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.038},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":0.94399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.57899999999999996},"min":{"1min":0.28699999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.88,"5min":1.214,"15min":1.214},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.626,"15min":0.64400000000000002},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.59699999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.627,"15min":0.65700000000000003},"min":{"1min":0.27800000000000002,"5min":0.224,"15min":0.224},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.73999999999999999,"15min":0.76800000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.054,"5min":2.27,"15min":2.27},"last":0.498}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.78800000000000003},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0049999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89600000000000002,"15min":0.95799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.175,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.252,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.85099999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.3540000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0529999999999999},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":0.79900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.4590000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0940000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.639,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.874}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.99099999999999999,"15min":1.069},"min":{"1min":0.59699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.417,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.222,"5min":1.1359999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":0.98399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.261 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.262 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.263 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.264 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.265 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.266 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.267 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-13T18:05:19.049215+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=19, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.268 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.269 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.270 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:33.271 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:09:34.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:09:34.495 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:09:53.273 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:09:53.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 Processor -- start 2024-09-13T18:09:53.398 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 -- start start 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f76a4071920 0x7f76a4070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a406f8b0 con 0x7f76a40c7b40 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a415cea0 con 0x7f76a41535f0 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.390+0000 7f76a359e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a415d180 con 0x7f76a4071920 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76a40c7b40 0x7f76a40c62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37604/0 (socket says 172.21.15.88:37604) 2024-09-13T18:09:53.399 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a2d9d700 1 -- 172.21.15.88:0/2257131600 learned_addr learned my addr 172.21.15.88:0/2257131600 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:09:53.400 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f7699d9b700 1 --2- 172.21.15.88:0/2257131600 >> v2:172.21.15.94:3300/0 conn(0x7f76a4071920 0x7f76a4070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a1d9b700 1 -- 172.21.15.88:0/2257131600 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371548047 0 0) 0x7f76a406f8b0 con 0x7f76a40c7b40 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a1d9b700 1 -- 172.21.15.88:0/2257131600 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76900035d0 con 0x7f76a40c7b40 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f7699d9b700 1 -- 172.21.15.88:0/2257131600 >> v1:172.21.15.94:6789/0 conn(0x7f76a41535f0 legacy=0x7f76a415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f7699d9b700 1 -- 172.21.15.88:0/2257131600 >> v1:172.21.15.88:6789/0 conn(0x7f76a40c7b40 legacy=0x7f76a40c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f7699d9b700 1 -- 172.21.15.88:0/2257131600 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a415d460 con 0x7f76a4071920 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f7699d9b700 1 --2- 172.21.15.88:0/2257131600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a4071920 0x7f76a4070300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f768c009850 tx=0x7f768c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a85b994909ed63fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a1d9b700 1 -- 172.21.15.88:0/2257131600 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c011830 con 0x7f76a4071920 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a1d9b700 1 -- 172.21.15.88:0/2257131600 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c011990 con 0x7f76a4071920 2024-09-13T18:09:53.401 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a1d9b700 1 -- 172.21.15.88:0/2257131600 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c011d40 con 0x7f76a4071920 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 -- 172.21.15.88:0/2257131600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a4071920 msgr2=0x7f76a4070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 --2- 172.21.15.88:0/2257131600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a4071920 0x7f76a4070300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f768c009850 tx=0x7f768c009b60 comp rx=0 tx=0).stop 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 -- 172.21.15.88:0/2257131600 shutdown_connections 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 --2- 172.21.15.88:0/2257131600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a4071920 0x7f76a4070300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 -- 172.21.15.88:0/2257131600 >> 172.21.15.88:0/2257131600 conn(0x7f76a406aa30 msgr2=0x7f76a40cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 -- 172.21.15.88:0/2257131600 shutdown_connections 2024-09-13T18:09:53.402 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.394+0000 7f76a359e700 1 -- 172.21.15.88:0/2257131600 wait complete. 2024-09-13T18:09:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 Processor -- start 2024-09-13T18:09:53.404 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- start start 2024-09-13T18:09:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a40c7b40 0x7f76a41f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:53.406 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a41535f0 0x7f76a41f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40c0760 con 0x7f76a40bd290 2024-09-13T18:09:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40bc320 con 0x7f76a41535f0 2024-09-13T18:09:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a40bdd10 con 0x7f76a40c7b40 2024-09-13T18:09:53.407 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45160/0 (socket says 172.21.15.88:45160) 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 -- 172.21.15.88:0/2740439003 learned_addr learned my addr 172.21.15.88:0/2740439003 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f7699d9b700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a41535f0 0x7f76a41f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a259c700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a40c7b40 0x7f76a41f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 -- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a40c7b40 msgr2=0x7f76a41f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a40c7b40 0x7f76a41f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 -- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a41535f0 msgr2=0x7f76a41f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a41535f0 0x7f76a41f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 -- 172.21.15.88:0/2740439003 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0094b0 con 0x7f76a40bd290 2024-09-13T18:09:53.408 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a2d9d700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f769c00cb40 tx=0x7f769c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c007500 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c007660 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c0079f0 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a41521f0 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.398+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a40bc850 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.402+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a40c1450 con 0x7f76a40bd290 2024-09-13T18:09:53.409 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.402+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f769c01b3b0 con 0x7f76a40bd290 2024-09-13T18:09:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.402+0000 7f769b7fe700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 0x7f7684068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:09:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.402+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f769c083c10 con 0x7f76a40bd290 2024-09-13T18:09:53.410 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.402+0000 7f76a259c700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 0x7f7684068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:09:53.411 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.406+0000 7f76a259c700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 0x7f7684068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7694000f60 tx=0x7f7694009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:09:53.416 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.410+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f76a40c1450 con 0x7f76a40bd290 2024-09-13T18:09:53.580 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.574+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76a4071120 con 0x7f7684066730 2024-09-13T18:09:53.594 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.586+0000 7f769b7fe700 1 -- 172.21.15.88:0/2740439003 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289348 (secure 0 0 0) 0x7f76a4071120 con 0x7f7684066730 2024-09-13T18:09:53.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 msgr2=0x7f7684068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 0x7f7684068bf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7694000f60 tx=0x7f7694009040 comp rx=0 tx=0).stop 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 msgr2=0x7f76a40c1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f769c00cb40 tx=0x7f769c00cb70 comp rx=0 tx=0).stop 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 shutdown_connections 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f7684066730 0x7f7684068bf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76a40bd290 0x7f76a40c1730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a41535f0 0x7f76a41f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.601 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 --2- 172.21.15.88:0/2740439003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a40c7b40 0x7f76a41f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:09:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 >> 172.21.15.88:0/2740439003 conn(0x7f76a406aa30 msgr2=0x7f76a406c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:09:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 shutdown_connections 2024-09-13T18:09:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:09:53.594+0000 7f76a359e700 1 -- 172.21.15.88:0/2740439003 wait complete. 2024-09-13T18:09:53.602 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:09:53.618 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T18:09:53.052507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10118,"ondisk_log_size":10118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300512,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":297971,"kb_avail":754674208,"statfs":{"total":773094113280,"available":772786388992,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":305122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004612"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.896553+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:32.896553+0000","last_peered":"2024-09-13T18:09:32.896553+0000","last_clean":"2024-09-13T18:09:32.896553+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:32.896553+0000","last_undegraded":"2024-09-13T18:09:32.896553+0000","last_fullsized":"2024-09-13T18:09:32.896553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":145,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:29.936027+0000","last_change":"2024-09-13T18:05:26.486808+0000","last_active":"2024-09-13T18:09:29.936027+0000","last_peered":"2024-09-13T18:09:29.936027+0000","last_clean":"2024-09-13T18:09:29.936027+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:29.936027+0000","last_undegraded":"2024-09-13T18:09:29.936027+0000","last_fullsized":"2024-09-13T18:09:29.936027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.150698+0000","last_change":"2024-09-13T18:09:41.150927+0000","last_active":"2024-09-13T18:09:41.150698+0000","last_peered":"2024-09-13T18:09:41.150698+0000","last_clean":"2024-09-13T18:09:41.150698+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:41.150698+0000","last_undegraded":"2024-09-13T18:09:41.150698+0000","last_fullsized":"2024-09-13T18:09:41.150698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.150650+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:46.865142+0000","scrub_duration":0.0032251630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:28.093373+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:28.093373+0000","last_peered":"2024-09-13T18:09:28.093373+0000","last_clean":"2024-09-13T18:09:28.093373+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:28.093373+0000","last_undegraded":"2024-09-13T18:09:28.093373+0000","last_fullsized":"2024-09-13T18:09:28.093373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239408+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:20.239408+0000","last_peered":"2024-09-13T18:09:20.239408+0000","last_clean":"2024-09-13T18:09:20.239408+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:20.239408+0000","last_undegraded":"2024-09-13T18:09:20.239408+0000","last_fullsized":"2024-09-13T18:09:20.239408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":149,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245395+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.245395+0000","last_peered":"2024-09-13T18:09:20.245395+0000","last_clean":"2024-09-13T18:09:20.245395+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.245395+0000","last_undegraded":"2024-09-13T18:09:20.245395+0000","last_fullsized":"2024-09-13T18:09:20.245395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.225020+0000","last_change":"2024-09-13T18:05:26.488264+0000","last_active":"2024-09-13T18:09:20.225020+0000","last_peered":"2024-09-13T18:09:20.225020+0000","last_clean":"2024-09-13T18:09:20.225020+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:09:20.225020+0000","last_undegraded":"2024-09-13T18:09:20.225020+0000","last_fullsized":"2024-09-13T18:09:20.225020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":208,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234223+0000","last_change":"2024-09-13T18:06:16.752158+0000","last_active":"2024-09-13T18:09:20.234223+0000","last_peered":"2024-09-13T18:09:20.234223+0000","last_clean":"2024-09-13T18:09:20.234223+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:20.234223+0000","last_undegraded":"2024-09-13T18:09:20.234223+0000","last_fullsized":"2024-09-13T18:09:20.234223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.248286+0000","last_change":"2024-09-13T18:05:26.502963+0000","last_active":"2024-09-13T18:09:20.248286+0000","last_peered":"2024-09-13T18:09:20.248286+0000","last_clean":"2024-09-13T18:09:20.248286+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:09:20.248286+0000","last_undegraded":"2024-09-13T18:09:20.248286+0000","last_fullsized":"2024-09-13T18:09:20.248286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234480+0000","last_change":"2024-09-13T18:06:16.720806+0000","last_active":"2024-09-13T18:09:20.234480+0000","last_peered":"2024-09-13T18:09:20.234480+0000","last_clean":"2024-09-13T18:09:20.234480+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:20.234480+0000","last_undegraded":"2024-09-13T18:09:20.234480+0000","last_fullsized":"2024-09-13T18:09:20.234480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.600750+0000","last_change":"2024-09-13T18:09:43.600946+0000","last_active":"2024-09-13T18:09:43.600750+0000","last_peered":"2024-09-13T18:09:43.600750+0000","last_clean":"2024-09-13T18:09:43.600750+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:43.600750+0000","last_undegraded":"2024-09-13T18:09:43.600750+0000","last_fullsized":"2024-09-13T18:09:43.600750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.600697+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:58.105197+0000","scrub_duration":0.0033266440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.227920+0000","last_change":"2024-09-13T18:05:26.498068+0000","last_active":"2024-09-13T18:09:20.227920+0000","last_peered":"2024-09-13T18:09:20.227920+0000","last_clean":"2024-09-13T18:09:20.227920+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:20.227920+0000","last_undegraded":"2024-09-13T18:09:20.227920+0000","last_fullsized":"2024-09-13T18:09:20.227920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.238167+0000","last_change":"2024-09-13T18:05:26.500098+0000","last_active":"2024-09-13T18:09:20.238167+0000","last_peered":"2024-09-13T18:09:20.238167+0000","last_clean":"2024-09-13T18:09:20.238167+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:09:20.238167+0000","last_undegraded":"2024-09-13T18:09:20.238167+0000","last_fullsized":"2024-09-13T18:09:20.238167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.222952+0000","last_change":"2024-09-13T18:05:26.487251+0000","last_active":"2024-09-13T18:09:20.222952+0000","last_peered":"2024-09-13T18:09:20.222952+0000","last_clean":"2024-09-13T18:09:20.222952+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:20.222952+0000","last_undegraded":"2024-09-13T18:09:20.222952+0000","last_fullsized":"2024-09-13T18:09:20.222952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.226082+0000","last_change":"2024-09-13T18:05:26.488560+0000","last_active":"2024-09-13T18:09:20.226082+0000","last_peered":"2024-09-13T18:09:20.226082+0000","last_clean":"2024-09-13T18:09:20.226082+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:20.226082+0000","last_undegraded":"2024-09-13T18:09:20.226082+0000","last_fullsized":"2024-09-13T18:09:20.226082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245453+0000","last_change":"2024-09-13T18:05:26.493106+0000","last_active":"2024-09-13T18:09:20.245453+0000","last_peered":"2024-09-13T18:09:20.245453+0000","last_clean":"2024-09-13T18:09:20.245453+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:20.245453+0000","last_undegraded":"2024-09-13T18:09:20.245453+0000","last_fullsized":"2024-09-13T18:09:20.245453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246469+0000","last_change":"2024-09-13T18:05:26.493776+0000","last_active":"2024-09-13T18:09:20.246469+0000","last_peered":"2024-09-13T18:09:20.246469+0000","last_clean":"2024-09-13T18:09:20.246469+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:20.246469+0000","last_undegraded":"2024-09-13T18:09:20.246469+0000","last_fullsized":"2024-09-13T18:09:20.246469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.585378+0000","last_change":"2024-09-13T18:09:42.585628+0000","last_active":"2024-09-13T18:09:42.585378+0000","last_peered":"2024-09-13T18:09:42.585378+0000","last_clean":"2024-09-13T18:09:42.585378+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:42.585378+0000","last_undegraded":"2024-09-13T18:09:42.585378+0000","last_fullsized":"2024-09-13T18:09:42.585378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.585326+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.780019+0000","scrub_duration":0.0035655249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.228006+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:20.228006+0000","last_peered":"2024-09-13T18:09:20.228006+0000","last_clean":"2024-09-13T18:09:20.228006+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:20.228006+0000","last_undegraded":"2024-09-13T18:09:20.228006+0000","last_fullsized":"2024-09-13T18:09:20.228006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":186,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.563480+0000","last_change":"2024-09-13T18:09:47.563669+0000","last_active":"2024-09-13T18:09:47.563480+0000","last_peered":"2024-09-13T18:09:47.563480+0000","last_clean":"2024-09-13T18:09:47.563480+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:47.563480+0000","last_undegraded":"2024-09-13T18:09:47.563480+0000","last_fullsized":"2024-09-13T18:09:47.563480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'161","last_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_deep_scrub":"22'161","last_deep_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.563428+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:21.403749+0000","scrub_duration":0.0031339699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":151,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.229906+0000","last_change":"2024-09-13T18:05:26.488824+0000","last_active":"2024-09-13T18:09:20.229906+0000","last_peered":"2024-09-13T18:09:20.229906+0000","last_clean":"2024-09-13T18:09:20.229906+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:20.229906+0000","last_undegraded":"2024-09-13T18:09:20.229906+0000","last_fullsized":"2024-09-13T18:09:20.229906+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245469+0000","last_change":"2024-09-13T18:05:26.501233+0000","last_active":"2024-09-13T18:09:20.245469+0000","last_peered":"2024-09-13T18:09:20.245469+0000","last_clean":"2024-09-13T18:09:20.245469+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:09:20.245469+0000","last_undegraded":"2024-09-13T18:09:20.245469+0000","last_fullsized":"2024-09-13T18:09:20.245469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":148,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.230640+0000","last_change":"2024-09-13T18:05:26.485771+0000","last_active":"2024-09-13T18:09:20.230640+0000","last_peered":"2024-09-13T18:09:20.230640+0000","last_clean":"2024-09-13T18:09:20.230640+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:20.230640+0000","last_undegraded":"2024-09-13T18:09:20.230640+0000","last_fullsized":"2024-09-13T18:09:20.230640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.908089+0000","last_change":"2024-09-13T18:05:26.493124+0000","last_active":"2024-09-13T18:09:31.908089+0000","last_peered":"2024-09-13T18:09:31.908089+0000","last_clean":"2024-09-13T18:09:31.908089+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:31.908089+0000","last_undegraded":"2024-09-13T18:09:31.908089+0000","last_fullsized":"2024-09-13T18:09:31.908089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.843320+0000","last_change":"2024-09-13T18:09:45.843320+0000","last_active":"2024-09-13T18:09:45.843320+0000","last_peered":"2024-09-13T18:09:45.843320+0000","last_clean":"2024-09-13T18:09:45.843320+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:45.843320+0000","last_undegraded":"2024-09-13T18:09:45.843320+0000","last_fullsized":"2024-09-13T18:09:45.843320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.843044+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:01.372679+0000","scrub_duration":0.0036834659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":213,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.406827+0000","last_change":"2024-09-13T18:05:26.497353+0000","last_active":"2024-09-13T18:09:32.406827+0000","last_peered":"2024-09-13T18:09:32.406827+0000","last_clean":"2024-09-13T18:09:32.406827+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:32.406827+0000","last_undegraded":"2024-09-13T18:09:32.406827+0000","last_fullsized":"2024-09-13T18:09:32.406827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:29.935979+0000","last_change":"2024-09-13T18:05:26.490418+0000","last_active":"2024-09-13T18:09:29.935979+0000","last_peered":"2024-09-13T18:09:29.935979+0000","last_clean":"2024-09-13T18:09:29.935979+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:29.935979+0000","last_undegraded":"2024-09-13T18:09:29.935979+0000","last_fullsized":"2024-09-13T18:09:29.935979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.904114+0000","last_change":"2024-09-13T18:09:43.904114+0000","last_active":"2024-09-13T18:09:43.904114+0000","last_peered":"2024-09-13T18:09:43.904114+0000","last_clean":"2024-09-13T18:09:43.904114+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:43.904114+0000","last_undegraded":"2024-09-13T18:09:43.904114+0000","last_fullsized":"2024-09-13T18:09:43.904114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'133","last_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_deep_scrub":"22'133","last_deep_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.903836+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:16.160498+0000","scrub_duration":0.00391735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.031091+0000","last_change":"2024-09-13T18:09:48.031403+0000","last_active":"2024-09-13T18:09:48.031091+0000","last_peered":"2024-09-13T18:09:48.031091+0000","last_clean":"2024-09-13T18:09:48.031091+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:48.031091+0000","last_undegraded":"2024-09-13T18:09:48.031091+0000","last_fullsized":"2024-09-13T18:09:48.031091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'118","last_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_deep_scrub":"22'118","last_deep_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.030972+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:17.435633+0000","scrub_duration":0.0033291369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":146,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.908070+0000","last_change":"2024-09-13T18:05:26.493771+0000","last_active":"2024-09-13T18:09:31.908070+0000","last_peered":"2024-09-13T18:09:31.908070+0000","last_clean":"2024-09-13T18:09:31.908070+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:31.908070+0000","last_undegraded":"2024-09-13T18:09:31.908070+0000","last_fullsized":"2024-09-13T18:09:31.908070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.534744+0000","last_change":"2024-09-13T18:09:44.535039+0000","last_active":"2024-09-13T18:09:44.534744+0000","last_peered":"2024-09-13T18:09:44.534744+0000","last_clean":"2024-09-13T18:09:44.534744+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:44.534744+0000","last_undegraded":"2024-09-13T18:09:44.534744+0000","last_fullsized":"2024-09-13T18:09:44.534744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.534635+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:12.372830+0000","scrub_duration":0.0037670020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.406882+0000","last_change":"2024-09-13T18:05:26.495311+0000","last_active":"2024-09-13T18:09:32.406882+0000","last_peered":"2024-09-13T18:09:32.406882+0000","last_clean":"2024-09-13T18:09:32.406882+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:32.406882+0000","last_undegraded":"2024-09-13T18:09:32.406882+0000","last_fullsized":"2024-09-13T18:09:32.406882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.216608+0000","last_change":"2024-09-13T18:09:44.216871+0000","last_active":"2024-09-13T18:09:44.216608+0000","last_peered":"2024-09-13T18:09:44.216608+0000","last_clean":"2024-09-13T18:09:44.216608+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:44.216608+0000","last_undegraded":"2024-09-13T18:09:44.216608+0000","last_fullsized":"2024-09-13T18:09:44.216608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.216550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:41.980606+0000","scrub_duration":0.003700942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'8","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.935660+0000","last_change":"2024-09-13T18:09:30.935774+0000","last_active":"2024-09-13T18:09:30.935660+0000","last_peered":"2024-09-13T18:09:30.935660+0000","last_clean":"2024-09-13T18:09:30.935660+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:09:30.935660+0000","last_undegraded":"2024-09-13T18:09:30.935660+0000","last_fullsized":"2024-09-13T18:09:30.935660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'8","last_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_deep_scrub":"22'8","last_deep_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.935626+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:28.699682+0000","scrub_duration":0.0055564289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.170779+0000","last_change":"2024-09-13T18:09:42.170943+0000","last_active":"2024-09-13T18:09:42.170779+0000","last_peered":"2024-09-13T18:09:42.170779+0000","last_clean":"2024-09-13T18:09:42.170779+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:42.170779+0000","last_undegraded":"2024-09-13T18:09:42.170779+0000","last_fullsized":"2024-09-13T18:09:42.170779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'137","last_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_deep_scrub":"22'137","last_deep_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.170737+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:26.463444+0000","scrub_duration":0.0029453280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'4","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.778239+0000","last_change":"2024-09-13T18:09:32.778450+0000","last_active":"2024-09-13T18:09:32.778239+0000","last_peered":"2024-09-13T18:09:32.778239+0000","last_clean":"2024-09-13T18:09:32.778239+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:09:32.778239+0000","last_undegraded":"2024-09-13T18:09:32.778239+0000","last_fullsized":"2024-09-13T18:09:32.778239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.778184+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:36.981991+0000","scrub_duration":0.0058238919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.902060+0000","last_change":"2024-09-13T18:09:36.902293+0000","last_active":"2024-09-13T18:09:36.902060+0000","last_peered":"2024-09-13T18:09:36.902060+0000","last_clean":"2024-09-13T18:09:36.902060+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:09:36.902060+0000","last_undegraded":"2024-09-13T18:09:36.902060+0000","last_fullsized":"2024-09-13T18:09:36.902060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.902006+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.204839+0000","scrub_duration":0.006253906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":184,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.234120+0000","last_change":"2024-09-13T18:05:26.490495+0000","last_active":"2024-09-13T18:09:20.234120+0000","last_peered":"2024-09-13T18:09:20.234120+0000","last_clean":"2024-09-13T18:09:20.234120+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:20.234120+0000","last_undegraded":"2024-09-13T18:09:20.234120+0000","last_fullsized":"2024-09-13T18:09:20.234120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.208608+0000","last_change":"2024-09-13T18:09:37.208876+0000","last_active":"2024-09-13T18:09:37.208608+0000","last_peered":"2024-09-13T18:09:37.208608+0000","last_clean":"2024-09-13T18:09:37.208608+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:09:37.208608+0000","last_undegraded":"2024-09-13T18:09:37.208608+0000","last_fullsized":"2024-09-13T18:09:37.208608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.208558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:40.391942+0000","scrub_duration":0.0030340900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.133597+0000","last_change":"2024-09-13T18:09:49.133895+0000","last_active":"2024-09-13T18:09:49.133597+0000","last_peered":"2024-09-13T18:09:49.133597+0000","last_clean":"2024-09-13T18:09:49.133597+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:49.133597+0000","last_undegraded":"2024-09-13T18:09:49.133597+0000","last_fullsized":"2024-09-13T18:09:49.133597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.133501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:03.638000+0000","scrub_duration":0.0029741580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'6","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.686704+0000","last_change":"2024-09-13T18:09:38.686942+0000","last_active":"2024-09-13T18:09:38.686704+0000","last_peered":"2024-09-13T18:09:38.686704+0000","last_clean":"2024-09-13T18:09:38.686704+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:09:38.686704+0000","last_undegraded":"2024-09-13T18:09:38.686704+0000","last_fullsized":"2024-09-13T18:09:38.686704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.686658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.524853+0000","scrub_duration":0.006664489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":254,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.179369+0000","last_change":"2024-09-13T18:09:33.179600+0000","last_active":"2024-09-13T18:09:33.179369+0000","last_peered":"2024-09-13T18:09:33.179369+0000","last_clean":"2024-09-13T18:09:33.179369+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:33.179369+0000","last_undegraded":"2024-09-13T18:09:33.179369+0000","last_fullsized":"2024-09-13T18:09:33.179369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'229","last_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_deep_scrub":"22'229","last_deep_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.179314+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.729956+0000","scrub_duration":0.0032080260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.189112+0000","last_change":"2024-09-13T18:09:36.189324+0000","last_active":"2024-09-13T18:09:36.189112+0000","last_peered":"2024-09-13T18:09:36.189112+0000","last_clean":"2024-09-13T18:09:36.189112+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:09:36.189112+0000","last_undegraded":"2024-09-13T18:09:36.189112+0000","last_fullsized":"2024-09-13T18:09:36.189112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.189056+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:20.481764+0000","scrub_duration":0.0058978600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.144751+0000","last_change":"2024-09-13T18:09:43.145140+0000","last_active":"2024-09-13T18:09:43.144751+0000","last_peered":"2024-09-13T18:09:43.144751+0000","last_clean":"2024-09-13T18:09:43.144751+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:43.144751+0000","last_undegraded":"2024-09-13T18:09:43.144751+0000","last_fullsized":"2024-09-13T18:09:43.144751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'141","last_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_deep_scrub":"22'141","last_deep_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.144592+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:46.327975+0000","scrub_duration":0.003201546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'12","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.124659+0000","last_change":"2024-09-13T18:09:42.124854+0000","last_active":"2024-09-13T18:09:42.124659+0000","last_peered":"2024-09-13T18:09:42.124659+0000","last_clean":"2024-09-13T18:09:42.124659+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:42.124659+0000","last_undegraded":"2024-09-13T18:09:42.124659+0000","last_fullsized":"2024-09-13T18:09:42.124659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.124622+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.319315+0000","scrub_duration":0.0081039130000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.153518+0000","last_change":"2024-09-13T18:09:41.153755+0000","last_active":"2024-09-13T18:09:41.153518+0000","last_peered":"2024-09-13T18:09:41.153518+0000","last_clean":"2024-09-13T18:09:41.153518+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:41.153518+0000","last_undegraded":"2024-09-13T18:09:41.153518+0000","last_fullsized":"2024-09-13T18:09:41.153518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.153466+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:03.341358+0000","scrub_duration":0.0036038070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'98","reported_seq":124,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.722892+0000","last_change":"2024-09-13T18:09:36.723073+0000","last_active":"2024-09-13T18:09:36.722892+0000","last_peered":"2024-09-13T18:09:36.722892+0000","last_clean":"2024-09-13T18:09:36.722892+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:36.722892+0000","last_undegraded":"2024-09-13T18:09:36.722892+0000","last_fullsized":"2024-09-13T18:09:36.722892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'98","last_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_deep_scrub":"22'98","last_deep_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.722843+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:10.917536+0000","scrub_duration":0.0097799819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.231945+0000","last_change":"2024-09-13T18:05:26.488451+0000","last_active":"2024-09-13T18:09:20.231945+0000","last_peered":"2024-09-13T18:09:20.231945+0000","last_clean":"2024-09-13T18:09:20.231945+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:09:20.231945+0000","last_undegraded":"2024-09-13T18:09:20.231945+0000","last_fullsized":"2024-09-13T18:09:20.231945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'10","reported_seq":36,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.075989+0000","last_change":"2024-09-13T18:09:30.076084+0000","last_active":"2024-09-13T18:09:30.075989+0000","last_peered":"2024-09-13T18:09:30.075989+0000","last_clean":"2024-09-13T18:09:30.075989+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:09:30.075989+0000","last_undegraded":"2024-09-13T18:09:30.075989+0000","last_fullsized":"2024-09-13T18:09:30.075989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_deep_scrub":"22'10","last_deep_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.075970+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:22.024885+0000","scrub_duration":0.0071596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.490414+0000","last_change":"2024-09-13T18:09:47.490666+0000","last_active":"2024-09-13T18:09:47.490414+0000","last_peered":"2024-09-13T18:09:47.490414+0000","last_clean":"2024-09-13T18:09:47.490414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:47.490414+0000","last_undegraded":"2024-09-13T18:09:47.490414+0000","last_fullsized":"2024-09-13T18:09:47.490414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.490364+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.759873+0000","scrub_duration":0.003581351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"20'3","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:07:48.071928+0000","last_change":"2024-09-13T18:05:26.120755+0000","last_active":"2024-09-13T18:07:48.071928+0000","last_peered":"2024-09-13T18:07:48.071928+0000","last_clean":"2024-09-13T18:07:48.071928+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:07:48.071928+0000","last_undegraded":"2024-09-13T18:07:48.071928+0000","last_fullsized":"2024-09-13T18:07:48.071928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":185,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239541+0000","last_change":"2024-09-13T18:05:26.489191+0000","last_active":"2024-09-13T18:09:20.239541+0000","last_peered":"2024-09-13T18:09:20.239541+0000","last_clean":"2024-09-13T18:09:20.239541+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:20.239541+0000","last_undegraded":"2024-09-13T18:09:20.239541+0000","last_fullsized":"2024-09-13T18:09:20.239541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'5","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.572878+0000","last_change":"2024-09-13T18:09:41.573145+0000","last_active":"2024-09-13T18:09:41.572878+0000","last_peered":"2024-09-13T18:09:41.572878+0000","last_clean":"2024-09-13T18:09:41.572878+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:09:41.572878+0000","last_undegraded":"2024-09-13T18:09:41.572878+0000","last_fullsized":"2024-09-13T18:09:41.572878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.572829+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:03.842338+0000","scrub_duration":0.0068975479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":190,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.577129+0000","last_change":"2024-09-13T18:09:45.577331+0000","last_active":"2024-09-13T18:09:45.577129+0000","last_peered":"2024-09-13T18:09:45.577129+0000","last_clean":"2024-09-13T18:09:45.577129+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:45.577129+0000","last_undegraded":"2024-09-13T18:09:45.577129+0000","last_fullsized":"2024-09-13T18:09:45.577129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'165","last_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_deep_scrub":"22'165","last_deep_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.577074+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:39.093321+0000","scrub_duration":0.0035030899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'24","reported_seq":50,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.680153+0000","last_change":"2024-09-13T18:09:32.680306+0000","last_active":"2024-09-13T18:09:32.680153+0000","last_peered":"2024-09-13T18:09:32.680153+0000","last_clean":"2024-09-13T18:09:32.680153+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:09:32.680153+0000","last_undegraded":"2024-09-13T18:09:32.680153+0000","last_fullsized":"2024-09-13T18:09:32.680153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.680105+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:14.568207+0000","scrub_duration":0.013891555999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":203,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.238611+0000","last_change":"2024-09-13T18:05:26.480524+0000","last_active":"2024-09-13T18:09:20.238611+0000","last_peered":"2024-09-13T18:09:20.238611+0000","last_clean":"2024-09-13T18:09:20.238611+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:20.238611+0000","last_undegraded":"2024-09-13T18:09:20.238611+0000","last_fullsized":"2024-09-13T18:09:20.238611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'4","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.294594+0000","last_change":"2024-09-13T18:09:32.294830+0000","last_active":"2024-09-13T18:09:32.294594+0000","last_peered":"2024-09-13T18:09:32.294594+0000","last_clean":"2024-09-13T18:09:32.294594+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:09:32.294594+0000","last_undegraded":"2024-09-13T18:09:32.294594+0000","last_fullsized":"2024-09-13T18:09:32.294594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.294535+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:57.770286+0000","scrub_duration":0.0068459749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.235485+0000","last_change":"2024-09-13T18:05:26.480578+0000","last_active":"2024-09-13T18:09:20.235485+0000","last_peered":"2024-09-13T18:09:20.235485+0000","last_clean":"2024-09-13T18:09:20.235485+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:20.235485+0000","last_undegraded":"2024-09-13T18:09:20.235485+0000","last_fullsized":"2024-09-13T18:09:20.235485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.597740+0000","last_change":"2024-09-13T18:09:38.598029+0000","last_active":"2024-09-13T18:09:38.597740+0000","last_peered":"2024-09-13T18:09:38.597740+0000","last_clean":"2024-09-13T18:09:38.597740+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:09:38.597740+0000","last_undegraded":"2024-09-13T18:09:38.597740+0000","last_fullsized":"2024-09-13T18:09:38.597740+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.597681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:42.801488+0000","scrub_duration":0.0054668370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.547010+0000","last_change":"2024-09-13T18:09:33.547319+0000","last_active":"2024-09-13T18:09:33.547010+0000","last_peered":"2024-09-13T18:09:33.547010+0000","last_clean":"2024-09-13T18:09:33.547010+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:33.547010+0000","last_undegraded":"2024-09-13T18:09:33.547010+0000","last_fullsized":"2024-09-13T18:09:33.547010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'138","last_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_deep_scrub":"22'138","last_deep_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.546894+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:32.849726+0000","scrub_duration":0.0035765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.150209+0000","last_change":"2024-09-13T18:09:38.150471+0000","last_active":"2024-09-13T18:09:38.150209+0000","last_peered":"2024-09-13T18:09:38.150209+0000","last_clean":"2024-09-13T18:09:38.150209+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:09:38.150209+0000","last_undegraded":"2024-09-13T18:09:38.150209+0000","last_fullsized":"2024-09-13T18:09:38.150209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.150113+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.914168+0000","scrub_duration":0.006034981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.237751+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:20.237751+0000","last_peered":"2024-09-13T18:09:20.237751+0000","last_clean":"2024-09-13T18:09:20.237751+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:20.237751+0000","last_undegraded":"2024-09-13T18:09:20.237751+0000","last_fullsized":"2024-09-13T18:09:20.237751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'5","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.623682+0000","last_change":"2024-09-13T18:09:34.623881+0000","last_active":"2024-09-13T18:09:34.623682+0000","last_peered":"2024-09-13T18:09:34.623682+0000","last_clean":"2024-09-13T18:09:34.623682+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:09:34.623682+0000","last_undegraded":"2024-09-13T18:09:34.623682+0000","last_fullsized":"2024-09-13T18:09:34.623682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.623632+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.811523+0000","scrub_duration":0.0076832480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.504404+0000","last_change":"2024-09-13T18:09:36.504722+0000","last_active":"2024-09-13T18:09:36.504404+0000","last_peered":"2024-09-13T18:09:36.504404+0000","last_clean":"2024-09-13T18:09:36.504404+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:36.504404+0000","last_undegraded":"2024-09-13T18:09:36.504404+0000","last_fullsized":"2024-09-13T18:09:36.504404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.504299+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.659785+0000","scrub_duration":0.0035044780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.537687+0000","last_change":"2024-09-13T18:09:39.537874+0000","last_active":"2024-09-13T18:09:39.537687+0000","last_peered":"2024-09-13T18:09:39.537687+0000","last_clean":"2024-09-13T18:09:39.537687+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:09:39.537687+0000","last_undegraded":"2024-09-13T18:09:39.537687+0000","last_fullsized":"2024-09-13T18:09:39.537687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.537607+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:01.807117+0000","scrub_duration":0.0094788149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:35.176804+0000","last_change":"2024-09-13T18:09:35.176804+0000","last_active":"2024-09-13T18:09:35.176804+0000","last_peered":"2024-09-13T18:09:35.176804+0000","last_clean":"2024-09-13T18:09:35.176804+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:09:35.176804+0000","last_undegraded":"2024-09-13T18:09:35.176804+0000","last_fullsized":"2024-09-13T18:09:35.176804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_clean_scrub_stamp":"2024-09-13T18:09:35.176624+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:40.891116+0000","scrub_duration":0.0065320040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":181,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.504290+0000","last_change":"2024-09-13T18:09:49.504486+0000","last_active":"2024-09-13T18:09:49.504290+0000","last_peered":"2024-09-13T18:09:49.504290+0000","last_clean":"2024-09-13T18:09:49.504290+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:49.504290+0000","last_undegraded":"2024-09-13T18:09:49.504290+0000","last_fullsized":"2024-09-13T18:09:49.504290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'158","last_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_deep_scrub":"22'158","last_deep_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.504233+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:04.008733+0000","scrub_duration":0.0035247329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.470534+0000","last_change":"2024-09-13T18:09:41.470738+0000","last_active":"2024-09-13T18:09:41.470534+0000","last_peered":"2024-09-13T18:09:41.470534+0000","last_clean":"2024-09-13T18:09:41.470534+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:09:41.470534+0000","last_undegraded":"2024-09-13T18:09:41.470534+0000","last_fullsized":"2024-09-13T18:09:41.470534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.470474+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:55.974974+0000","scrub_duration":0.0059467979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.072172+0000","last_change":"2024-09-13T18:09:32.072172+0000","last_active":"2024-09-13T18:09:32.072172+0000","last_peered":"2024-09-13T18:09:32.072172+0000","last_clean":"2024-09-13T18:09:32.072172+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:32.072172+0000","last_undegraded":"2024-09-13T18:09:32.072172+0000","last_fullsized":"2024-09-13T18:09:32.072172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.071942+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:41.490052+0000","scrub_duration":0.0031235960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'12","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.594539+0000","last_change":"2024-09-13T18:09:40.594759+0000","last_active":"2024-09-13T18:09:40.594539+0000","last_peered":"2024-09-13T18:09:40.594539+0000","last_clean":"2024-09-13T18:09:40.594539+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:40.594539+0000","last_undegraded":"2024-09-13T18:09:40.594539+0000","last_fullsized":"2024-09-13T18:09:40.594539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.594477+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:33.040319+0000","scrub_duration":0.007660605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.079385+0000","last_change":"2024-09-13T18:09:44.079588+0000","last_active":"2024-09-13T18:09:44.079385+0000","last_peered":"2024-09-13T18:09:44.079385+0000","last_clean":"2024-09-13T18:09:44.079385+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:44.079385+0000","last_undegraded":"2024-09-13T18:09:44.079385+0000","last_fullsized":"2024-09-13T18:09:44.079385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.079336+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.917531+0000","scrub_duration":0.0030879660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.120445+0000","last_change":"2024-09-13T18:09:42.120682+0000","last_active":"2024-09-13T18:09:42.120445+0000","last_peered":"2024-09-13T18:09:42.120445+0000","last_clean":"2024-09-13T18:09:42.120445+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:09:42.120445+0000","last_undegraded":"2024-09-13T18:09:42.120445+0000","last_fullsized":"2024-09-13T18:09:42.120445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.120388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:11.525048+0000","scrub_duration":0.0039379339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.206072+0000","last_change":"2024-09-13T18:09:36.206072+0000","last_active":"2024-09-13T18:09:36.206072+0000","last_peered":"2024-09-13T18:09:36.206072+0000","last_clean":"2024-09-13T18:09:36.206072+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:36.206072+0000","last_undegraded":"2024-09-13T18:09:36.206072+0000","last_fullsized":"2024-09-13T18:09:36.206072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'145","last_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_deep_scrub":"22'145","last_deep_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.205813+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:46.067844+0000","scrub_duration":0.0034410579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.185425+0000","last_change":"2024-09-13T18:09:34.185425+0000","last_active":"2024-09-13T18:09:34.185425+0000","last_peered":"2024-09-13T18:09:34.185425+0000","last_clean":"2024-09-13T18:09:34.185425+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:09:34.185425+0000","last_undegraded":"2024-09-13T18:09:34.185425+0000","last_fullsized":"2024-09-13T18:09:34.185425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.185154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.373045+0000","scrub_duration":0.0028065149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":158,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.907878+0000","last_change":"2024-09-13T18:05:26.501521+0000","last_active":"2024-09-13T18:09:31.907878+0000","last_peered":"2024-09-13T18:09:31.907878+0000","last_clean":"2024-09-13T18:09:31.907878+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:31.907878+0000","last_undegraded":"2024-09-13T18:09:31.907878+0000","last_fullsized":"2024-09-13T18:09:31.907878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:46.350372+0000","last_change":"2024-09-13T18:09:46.350687+0000","last_active":"2024-09-13T18:09:46.350372+0000","last_peered":"2024-09-13T18:09:46.350372+0000","last_clean":"2024-09-13T18:09:46.350372+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:09:46.350372+0000","last_undegraded":"2024-09-13T18:09:46.350372+0000","last_fullsized":"2024-09-13T18:09:46.350372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_clean_scrub_stamp":"2024-09-13T18:09:46.350302+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:12.636464+0000","scrub_duration":0.0071307339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.119801+0000","last_change":"2024-09-13T18:09:47.120009+0000","last_active":"2024-09-13T18:09:47.119801+0000","last_peered":"2024-09-13T18:09:47.119801+0000","last_clean":"2024-09-13T18:09:47.119801+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:47.119801+0000","last_undegraded":"2024-09-13T18:09:47.119801+0000","last_fullsized":"2024-09-13T18:09:47.119801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.119752+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.389262+0000","scrub_duration":0.0031522669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.236451+0000","last_change":"2024-09-13T18:09:33.236451+0000","last_active":"2024-09-13T18:09:33.236451+0000","last_peered":"2024-09-13T18:09:33.236451+0000","last_clean":"2024-09-13T18:09:33.236451+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:33.236451+0000","last_undegraded":"2024-09-13T18:09:33.236451+0000","last_fullsized":"2024-09-13T18:09:33.236451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.236168+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:32.316160+0000","scrub_duration":0.0077651450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.916418+0000","last_change":"2024-09-13T18:09:42.916418+0000","last_active":"2024-09-13T18:09:42.916418+0000","last_peered":"2024-09-13T18:09:42.916418+0000","last_clean":"2024-09-13T18:09:42.916418+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:42.916418+0000","last_undegraded":"2024-09-13T18:09:42.916418+0000","last_fullsized":"2024-09-13T18:09:42.916418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.915992+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:05.185502+0000","scrub_duration":0.0037716170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.710102+0000","last_change":"2024-09-13T18:09:34.710102+0000","last_active":"2024-09-13T18:09:34.710102+0000","last_peered":"2024-09-13T18:09:34.710102+0000","last_clean":"2024-09-13T18:09:34.710102+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:09:34.710102+0000","last_undegraded":"2024-09-13T18:09:34.710102+0000","last_fullsized":"2024-09-13T18:09:34.710102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.709622+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:27.155464+0000","scrub_duration":0.006819388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.111012+0000","last_change":"2024-09-13T18:09:37.111012+0000","last_active":"2024-09-13T18:09:37.111012+0000","last_peered":"2024-09-13T18:09:37.111012+0000","last_clean":"2024-09-13T18:09:37.111012+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:37.111012+0000","last_undegraded":"2024-09-13T18:09:37.111012+0000","last_fullsized":"2024-09-13T18:09:37.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.110762+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:59.856602+0000","scrub_duration":0.0030931550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.353833+0000","last_change":"2024-09-13T18:09:48.353833+0000","last_active":"2024-09-13T18:09:48.353833+0000","last_peered":"2024-09-13T18:09:48.353833+0000","last_clean":"2024-09-13T18:09:48.353833+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:09:48.353833+0000","last_undegraded":"2024-09-13T18:09:48.353833+0000","last_fullsized":"2024-09-13T18:09:48.353833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.353503+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:44.466201+0000","scrub_duration":0.0064759630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.166659+0000","last_change":"2024-09-13T18:09:39.166659+0000","last_active":"2024-09-13T18:09:39.166659+0000","last_peered":"2024-09-13T18:09:39.166659+0000","last_clean":"2024-09-13T18:09:39.166659+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:39.166659+0000","last_undegraded":"2024-09-13T18:09:39.166659+0000","last_fullsized":"2024-09-13T18:09:39.166659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.166391+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:21.054493+0000","scrub_duration":0.003674783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.194698+0000","last_change":"2024-09-13T18:09:30.194698+0000","last_active":"2024-09-13T18:09:30.194698+0000","last_peered":"2024-09-13T18:09:30.194698+0000","last_clean":"2024-09-13T18:09:30.194698+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:09:30.194698+0000","last_undegraded":"2024-09-13T18:09:30.194698+0000","last_fullsized":"2024-09-13T18:09:30.194698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.194421+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.647061+0000","scrub_duration":0.0066843090000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.866987+0000","last_change":"2024-09-13T18:09:44.866987+0000","last_active":"2024-09-13T18:09:44.866987+0000","last_peered":"2024-09-13T18:09:44.866987+0000","last_clean":"2024-09-13T18:09:44.866987+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:44.866987+0000","last_undegraded":"2024-09-13T18:09:44.866987+0000","last_fullsized":"2024-09-13T18:09:44.866987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'153","last_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_deep_scrub":"22'153","last_deep_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.866743+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:02.632323+0000","scrub_duration":0.0035320389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.124356+0000","last_change":"2024-09-13T18:09:40.124356+0000","last_active":"2024-09-13T18:09:40.124356+0000","last_peered":"2024-09-13T18:09:40.124356+0000","last_clean":"2024-09-13T18:09:40.124356+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:09:40.124356+0000","last_undegraded":"2024-09-13T18:09:40.124356+0000","last_fullsized":"2024-09-13T18:09:40.124356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.124055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:32.569897+0000","scrub_duration":0.0056691459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.237110+0000","last_change":"2024-09-13T18:05:26.490577+0000","last_active":"2024-09-13T18:09:20.237110+0000","last_peered":"2024-09-13T18:09:20.237110+0000","last_clean":"2024-09-13T18:09:20.237110+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:20.237110+0000","last_undegraded":"2024-09-13T18:09:20.237110+0000","last_fullsized":"2024-09-13T18:09:20.237110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'7","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.367110+0000","last_change":"2024-09-13T18:09:45.367333+0000","last_active":"2024-09-13T18:09:45.367110+0000","last_peered":"2024-09-13T18:09:45.367110+0000","last_clean":"2024-09-13T18:09:45.367110+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:09:45.367110+0000","last_undegraded":"2024-09-13T18:09:45.367110+0000","last_fullsized":"2024-09-13T18:09:45.367110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.367056+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:19.207376+0000","scrub_duration":0.0060695089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.607128+0000","last_change":"2024-09-13T18:09:48.607128+0000","last_active":"2024-09-13T18:09:48.607128+0000","last_peered":"2024-09-13T18:09:48.607128+0000","last_clean":"2024-09-13T18:09:48.607128+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:48.607128+0000","last_undegraded":"2024-09-13T18:09:48.607128+0000","last_fullsized":"2024-09-13T18:09:48.607128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'128","last_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_deep_scrub":"22'128","last_deep_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.606859+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:14.893021+0000","scrub_duration":0.0029830960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245821+0000","last_change":"2024-09-13T18:05:26.500794+0000","last_active":"2024-09-13T18:09:20.245821+0000","last_peered":"2024-09-13T18:09:20.245821+0000","last_clean":"2024-09-13T18:09:20.245821+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:09:20.245821+0000","last_undegraded":"2024-09-13T18:09:20.245821+0000","last_fullsized":"2024-09-13T18:09:20.245821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.447885+0000","last_change":"2024-09-13T18:09:43.448186+0000","last_active":"2024-09-13T18:09:43.447885+0000","last_peered":"2024-09-13T18:09:43.447885+0000","last_clean":"2024-09-13T18:09:43.447885+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:09:43.447885+0000","last_undegraded":"2024-09-13T18:09:43.447885+0000","last_fullsized":"2024-09-13T18:09:43.447885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.447804+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:36.964051+0000","scrub_duration":0.0057891319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246030+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.246030+0000","last_peered":"2024-09-13T18:09:20.246030+0000","last_clean":"2024-09-13T18:09:20.246030+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.246030+0000","last_undegraded":"2024-09-13T18:09:20.246030+0000","last_fullsized":"2024-09-13T18:09:20.246030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'5","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:08:00.064362+0000","last_change":"2024-09-13T18:05:26.119346+0000","last_active":"2024-09-13T18:08:00.064362+0000","last_peered":"2024-09-13T18:08:00.064362+0000","last_clean":"2024-09-13T18:08:00.064362+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:08:00.064362+0000","last_undegraded":"2024-09-13T18:08:00.064362+0000","last_fullsized":"2024-09-13T18:08:00.064362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:25.078245+0000","last_clean_scrub_stamp":"2024-09-13T18:05:25.078245+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":150,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:29.441479+0000","last_change":"2024-09-13T18:05:26.504708+0000","last_active":"2024-09-13T18:09:29.441479+0000","last_peered":"2024-09-13T18:09:29.441479+0000","last_clean":"2024-09-13T18:09:29.441479+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:29.441479+0000","last_undegraded":"2024-09-13T18:09:29.441479+0000","last_fullsized":"2024-09-13T18:09:29.441479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.898069+0000","last_change":"2024-09-13T18:09:39.898399+0000","last_active":"2024-09-13T18:09:39.898069+0000","last_peered":"2024-09-13T18:09:39.898069+0000","last_clean":"2024-09-13T18:09:39.898069+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:09:39.898069+0000","last_undegraded":"2024-09-13T18:09:39.898069+0000","last_fullsized":"2024-09-13T18:09:39.898069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.897960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.053446+0000","scrub_duration":0.0032269820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.907452+0000","last_change":"2024-09-13T18:09:48.907691+0000","last_active":"2024-09-13T18:09:48.907452+0000","last_peered":"2024-09-13T18:09:48.907452+0000","last_clean":"2024-09-13T18:09:48.907452+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:48.907452+0000","last_undegraded":"2024-09-13T18:09:48.907452+0000","last_fullsized":"2024-09-13T18:09:48.907452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'152","last_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_deep_scrub":"22'152","last_deep_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.907399+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:15.193562+0000","scrub_duration":0.0033935720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'13","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.063246+0000","last_change":"2024-09-13T18:09:31.063246+0000","last_active":"2024-09-13T18:09:31.063246+0000","last_peered":"2024-09-13T18:09:31.063246+0000","last_clean":"2024-09-13T18:09:31.063246+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:09:31.063246+0000","last_undegraded":"2024-09-13T18:09:31.063246+0000","last_fullsized":"2024-09-13T18:09:31.063246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_clean_scrub_stamp":"2024-09-13T18:09:31.063128+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:51.931136+0000","scrub_duration":0.0086318439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":282,"ondisk_log_size":282,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509498,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.65800000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.71099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.73999999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.80500000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.139,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.93600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1120000000000001,"5min":1.516,"15min":1.516},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.499},"max":{"1min":3.7919999999999998,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.101},{"interface":"front","average":{"1min":1.012,"5min":0.96699999999999997,"15min":1.0129999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2330000000000001,"5min":1.907,"15min":1.907},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.135,"5min":1.048,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.147}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.998,"15min":1.077},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4279999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.024,"15min":1.05},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.4539999999999997,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":0.91800000000000004}]}]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.66200000000000003},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.73999999999999999,"5min":2.077,"15min":2.077},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":11.384,"5min":11.384,"15min":11.384},"last":1.0049999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.749},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4590000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.93799999999999994,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.181,"5min":1.347,"15min":1.347},"last":1.2230000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.319,"5min":1.452,"15min":1.452},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.006,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1990000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.222,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0349999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.377,"5min":1.46,"15min":1.46},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":0.94799999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542201,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.232,"15min":1.232},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.91000000000000003,"15min":1.0369999999999999},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.49,"5min":6.093,"15min":6.093},"last":1.054}]},{"osd":1,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.0169999999999999,"15min":1.1479999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5349999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.149,"5min":1.0509999999999999,"15min":1.161},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.0680000000000001,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":1.0960000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":0.90100000000000002,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.435,"15min":0.435},"max":{"1min":5.798,"5min":5.798,"15min":5.798},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.264,"5min":0.99199999999999999,"15min":0.98399999999999999},"min":{"1min":0.58599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7670000000000003,"5min":5.7670000000000003,"15min":5.7670000000000003},"last":0.90600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94599999999999995,"15min":0.97799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3420000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.161,"15min":1.2729999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.8230000000000004,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.1339999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1519999999999999,"15min":1.252},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9470000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.236,"5min":1.1830000000000001,"15min":1.2869999999999999},"min":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.8440000000000003,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":0.95999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2949999999999999,"15min":1.4450000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7359999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.123,"15min":1.2110000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":5.8689999999999998,"5min":5.8689999999999998,"15min":5.8689999999999998},"last":1.0149999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542201,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":1.095},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.79500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.86599999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.23,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.99199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.90400000000000003,"15min":0.95199999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2789999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":1.0229999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5329999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0589999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.097,"15min":1.1259999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.552,"5min":1.621,"15min":1.621},"last":1.05}]}]},{"osd":4,"up_from":14,"seq":60129542201,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0940000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.82199999999999995,"15min":0.879},"min":{"1min":0.44800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93700000000000006,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":1.0209999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.075,"5min":3.194,"15min":3.194},"last":1.169},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.599,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91100000000000003,"15min":0.95499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6000000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.93700000000000006}]},{"osd":3,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6279999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.93600000000000005,"15min":0.97499999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1859999999999999,"5min":3.125,"15min":3.125},"last":1.137}]},{"osd":5,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.91500000000000004,"15min":1.002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1930000000000001,"5min":1.909,"15min":1.909},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0509999999999999,"15min":1.105},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.679,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98299999999999998,"15min":1.0429999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.872,"5min":1.0069999999999999,"15min":1.075},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2410000000000001,"5min":1.885,"15min":1.885},"last":1.109}]},{"osd":7,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.083,"15min":1.149},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0760000000000001,"15min":1.165},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3560000000000001,"5min":1.851,"15min":1.851},"last":1.21}]}]},{"osd":3,"up_from":14,"seq":60129542201,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.90000000000000002,"5min":1.226,"15min":1.226},"last":1.006},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.9079999999999999,"5min":2.9079999999999999,"15min":2.9079999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.79800000000000004,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.7729999999999997,"5min":4.7729999999999997,"15min":4.7729999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.75},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0469999999999999,"5min":1.798,"15min":1.798},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.88100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.359,"15min":1.359},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.83599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.96699999999999997},"min":{"1min":0.50600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2629999999999999,"5min":1.905,"15min":1.905},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.95099999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2190000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.94199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.085,"15min":1.0960000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.012,"15min":1.0589999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.123}]},{"osd":7,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98699999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.198,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.0900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.57699999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86199999999999999,"15min":0.83999999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.1520000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.94499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":0.97799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81000000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.93300000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.143},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":1.1220000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.0720000000000001,"5min":1.214,"15min":1.214},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.83499999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70999999999999996,"15min":0.75800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.107,"5min":2.27,"15min":2.27},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.78800000000000003},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0049999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89600000000000002,"15min":0.95799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.175,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.002},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.252,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.3540000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.321},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0529999999999999},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.071}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.4590000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0940000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.639,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.212}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.99099999999999999,"15min":1.069},"min":{"1min":0.59699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.417,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.1359999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.2410000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.624 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.625 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.626 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.627 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.628 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.628 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.628 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.628 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.628 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.629 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.629 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-09-13T18:05:25.078245+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=25, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.629 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:09:53.629 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:10:04.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:10:04.636 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:10:13.630 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:10:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 Processor -- start 2024-09-13T18:10:13.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- start start 2024-09-13T18:10:13.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c06e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c06dce0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.752 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2c06bcb0 con 0x7f0e2c06fae0 2024-09-13T18:10:13.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c06e010 con 0x7f0e2c150b30 2024-09-13T18:10:13.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e30ff2700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0e2c06f6a0 0x7f0e2c0c3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58590/0 (socket says 172.21.15.88:58590) 2024-09-13T18:10:13.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e30ff2700 1 -- 172.21.15.88:0/767992083 learned_addr learned my addr 172.21.15.88:0/767992083 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:13.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e317f3700 1 --2- 172.21.15.88:0/767992083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c06e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98523576 0 0) 0x7f0e2c06dce0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e180035d0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478115557 0 0) 0x7f0e2c06bcb0 con 0x7f0e2c06fae0 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c06dce0 con 0x7f0e2c06fae0 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e317f3700 1 -- 172.21.15.88:0/767992083 >> v1:172.21.15.94:6789/0 conn(0x7f0e2c06fae0 legacy=0x7f0e2c1615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e317f3700 1 -- 172.21.15.88:0/767992083 >> v1:172.21.15.88:6789/0 conn(0x7f0e2c06f6a0 legacy=0x7f0e2c0c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.754 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e317f3700 1 -- 172.21.15.88:0/767992083 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c06bf70 con 0x7f0e2c150b30 2024-09-13T18:10:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e317f3700 1 --2- 172.21.15.88:0/767992083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c06e430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009880 tx=0x7f0e1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1211310e0512ac3b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011830 con 0x7f0e2c150b30 2024-09-13T18:10:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c011990 con 0x7f0e2c150b30 2024-09-13T18:10:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e23fff700 1 -- 172.21.15.88:0/767992083 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c011d20 con 0x7f0e2c150b30 2024-09-13T18:10:13.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- 172.21.15.88:0/767992083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 msgr2=0x7f0e2c06e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 --2- 172.21.15.88:0/767992083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c06e430 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009880 tx=0x7f0e1c009b90 comp rx=0 tx=0).stop 2024-09-13T18:10:13.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- 172.21.15.88:0/767992083 shutdown_connections 2024-09-13T18:10:13.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 --2- 172.21.15.88:0/767992083 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c06e430 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- 172.21.15.88:0/767992083 >> 172.21.15.88:0/767992083 conn(0x7f0e2c0ca720 msgr2=0x7f0e2c0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- 172.21.15.88:0/767992083 shutdown_connections 2024-09-13T18:10:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.750+0000 7f0e327f5700 1 -- 172.21.15.88:0/767992083 wait complete. 2024-09-13T18:10:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 Processor -- start 2024-09-13T18:10:13.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 -- start start 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2c06fae0 0x7f0e2c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c2ff0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c3740 con 0x7f0e2c06fae0 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e327f5700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c0c39e0 con 0x7f0e2c150b30 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e317f3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.760 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e317f3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:42898/0 (socket says 172.21.15.88:42898) 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e317f3700 1 -- 172.21.15.88:0/1733532683 learned_addr learned my addr 172.21.15.88:0/1733532683 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e31ff4700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.754+0000 7f0e30ff2700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2c06fae0 0x7f0e2c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 -- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 msgr2=0x7f0e2c14d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c14d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 -- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2c06fae0 msgr2=0x7f0e2c1558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2c06fae0 0x7f0e2c1558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 -- 172.21.15.88:0/1733532683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0094b0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e317f3700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c013040 tx=0x7f0e1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c01a8c0 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1c01e070 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.761 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c1f2830 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c01ac60 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c0c3240 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.762 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c06b900 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.758+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f0e1c02d450 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.763 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.762+0000 7f0e21ffb700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 0x7f0e10068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:13.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.762+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0e1c085390 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.764 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.762+0000 7f0e30ff2700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 0x7f0e10068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:13.765 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.762+0000 7f0e30ff2700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 0x7f0e10068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c1590 tx=0x7f0e28007e00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:13.768 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.766+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f0e1c052770 con 0x7f0e2c06f6a0 2024-09-13T18:10:13.935 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.934+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e2c06c530 con 0x7f0e10066730 2024-09-13T18:10:13.952 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.950+0000 7f0e21ffb700 1 -- 172.21.15.88:0/1733532683 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291094 (secure 0 0 0) 0x7f0e28006bf0 con 0x7f0e10066730 2024-09-13T18:10:13.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 msgr2=0x7f0e10068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 0x7f0e10068bf0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0c1590 tx=0x7f0e28007e00 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 msgr2=0x7f0e2c14b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c013040 tx=0x7f0e1c004770 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 shutdown_connections 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f0e10066730 0x7f0e10068bf0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0e2c150b30 0x7f0e2c14d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0e2c06fae0 0x7f0e2c1558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 --2- 172.21.15.88:0/1733532683 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0e2c06f6a0 0x7f0e2c14b550 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 >> 172.21.15.88:0/1733532683 conn(0x7f0e2c0ca720 msgr2=0x7f0e2c0c5150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 shutdown_connections 2024-09-13T18:10:13.960 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:13.954+0000 7f0e327f5700 1 -- 172.21.15.88:0/1733532683 wait complete. 2024-09-13T18:10:13.961 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:10:13.975 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-09-13T18:10:13.060065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10121,"ondisk_log_size":10121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":300512,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":297971,"kb_avail":754674208,"statfs":{"total":773094113280,"available":772786388992,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":305122872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004587"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.896553+0000","last_change":"2024-09-13T18:05:26.497800+0000","last_active":"2024-09-13T18:09:32.896553+0000","last_peered":"2024-09-13T18:09:32.896553+0000","last_clean":"2024-09-13T18:09:32.896553+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:09:32.896553+0000","last_undegraded":"2024-09-13T18:09:32.896553+0000","last_fullsized":"2024-09-13T18:09:32.896553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.162407+0000","last_change":"2024-09-13T18:09:53.162596+0000","last_active":"2024-09-13T18:09:53.162407+0000","last_peered":"2024-09-13T18:09:53.162407+0000","last_clean":"2024-09-13T18:09:53.162407+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:53.162407+0000","last_undegraded":"2024-09-13T18:09:53.162407+0000","last_fullsized":"2024-09-13T18:09:53.162407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-09-13T18:09:53.162357+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-09-13T18:09:53.162357+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.162357+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:27.002678+0000","scrub_duration":0.00337828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.150698+0000","last_change":"2024-09-13T18:09:41.150927+0000","last_active":"2024-09-13T18:09:41.150698+0000","last_peered":"2024-09-13T18:09:41.150698+0000","last_clean":"2024-09-13T18:09:41.150698+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:41.150698+0000","last_undegraded":"2024-09-13T18:09:41.150698+0000","last_fullsized":"2024-09-13T18:09:41.150698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.150650+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:46.865142+0000","scrub_duration":0.0032251630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":188,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:28.093373+0000","last_change":"2024-09-13T18:05:26.493937+0000","last_active":"2024-09-13T18:09:28.093373+0000","last_peered":"2024-09-13T18:09:28.093373+0000","last_clean":"2024-09-13T18:09:28.093373+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:09:28.093373+0000","last_undegraded":"2024-09-13T18:09:28.093373+0000","last_fullsized":"2024-09-13T18:09:28.093373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.239408+0000","last_change":"2024-09-13T18:05:26.487940+0000","last_active":"2024-09-13T18:09:20.239408+0000","last_peered":"2024-09-13T18:09:20.239408+0000","last_clean":"2024-09-13T18:09:20.239408+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:09:20.239408+0000","last_undegraded":"2024-09-13T18:09:20.239408+0000","last_fullsized":"2024-09-13T18:09:20.239408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":149,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.245395+0000","last_change":"2024-09-13T18:05:26.500738+0000","last_active":"2024-09-13T18:09:20.245395+0000","last_peered":"2024-09-13T18:09:20.245395+0000","last_clean":"2024-09-13T18:09:20.245395+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:09:20.245395+0000","last_undegraded":"2024-09-13T18:09:20.245395+0000","last_fullsized":"2024-09-13T18:09:20.245395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:00.280852+0000","last_change":"2024-09-13T18:10:00.281176+0000","last_active":"2024-09-13T18:10:00.280852+0000","last_peered":"2024-09-13T18:10:00.280852+0000","last_clean":"2024-09-13T18:10:00.280852+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:10:00.280852+0000","last_undegraded":"2024-09-13T18:10:00.280852+0000","last_fullsized":"2024-09-13T18:10:00.280852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'164","last_scrub_stamp":"2024-09-13T18:10:00.280730+0000","last_deep_scrub":"22'164","last_deep_scrub_stamp":"2024-09-13T18:10:00.280730+0000","last_clean_scrub_stamp":"2024-09-13T18:10:00.280730+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:16.548461+0000","scrub_duration":0.0038247509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":219,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:59.001012+0000","last_change":"2024-09-13T18:09:59.001230+0000","last_active":"2024-09-13T18:09:59.001012+0000","last_peered":"2024-09-13T18:09:59.001012+0000","last_clean":"2024-09-13T18:09:59.001012+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:59.001012+0000","last_undegraded":"2024-09-13T18:09:59.001012+0000","last_fullsized":"2024-09-13T18:09:59.001012+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'186","last_scrub_stamp":"2024-09-13T18:09:59.000963+0000","last_deep_scrub":"22'186","last_deep_scrub_stamp":"2024-09-13T18:09:59.000963+0000","last_clean_scrub_stamp":"2024-09-13T18:09:59.000963+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.118242+0000","scrub_duration":0.0033296850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:09.262310+0000","last_change":"2024-09-13T18:10:09.262529+0000","last_active":"2024-09-13T18:10:09.262310+0000","last_peered":"2024-09-13T18:10:09.262310+0000","last_clean":"2024-09-13T18:10:09.262310+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:10:09.262310+0000","last_undegraded":"2024-09-13T18:10:09.262310+0000","last_fullsized":"2024-09-13T18:10:09.262310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'152","last_scrub_stamp":"2024-09-13T18:10:09.262250+0000","last_deep_scrub":"22'152","last_deep_scrub_stamp":"2024-09-13T18:10:09.262250+0000","last_clean_scrub_stamp":"2024-09-13T18:10:09.262250+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:13.932163+0000","scrub_duration":0.003204415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:55.528093+0000","last_change":"2024-09-13T18:09:55.528306+0000","last_active":"2024-09-13T18:09:55.528093+0000","last_peered":"2024-09-13T18:09:55.528093+0000","last_clean":"2024-09-13T18:09:55.528093+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:55.528093+0000","last_undegraded":"2024-09-13T18:09:55.528093+0000","last_fullsized":"2024-09-13T18:09:55.528093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-09-13T18:09:55.528042+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-09-13T18:09:55.528042+0000","last_clean_scrub_stamp":"2024-09-13T18:09:55.528042+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:53.866210+0000","scrub_duration":0.0033343040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":214,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.600750+0000","last_change":"2024-09-13T18:09:43.600946+0000","last_active":"2024-09-13T18:09:43.600750+0000","last_peered":"2024-09-13T18:09:43.600750+0000","last_clean":"2024-09-13T18:09:43.600750+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:43.600750+0000","last_undegraded":"2024-09-13T18:09:43.600750+0000","last_fullsized":"2024-09-13T18:09:43.600750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.600697+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:58.105197+0000","scrub_duration":0.0033266440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:50.263881+0000","last_change":"2024-09-13T18:09:50.264137+0000","last_active":"2024-09-13T18:09:50.263881+0000","last_peered":"2024-09-13T18:09:50.263881+0000","last_clean":"2024-09-13T18:09:50.263881+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:50.263881+0000","last_undegraded":"2024-09-13T18:09:50.263881+0000","last_fullsized":"2024-09-13T18:09:50.263881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'142","last_scrub_stamp":"2024-09-13T18:09:50.263785+0000","last_deep_scrub":"22'142","last_deep_scrub_stamp":"2024-09-13T18:09:50.263785+0000","last_clean_scrub_stamp":"2024-09-13T18:09:50.263785+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:49.566618+0000","scrub_duration":0.0030756429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:00.003653+0000","last_change":"2024-09-13T18:10:00.003964+0000","last_active":"2024-09-13T18:10:00.003653+0000","last_peered":"2024-09-13T18:10:00.003653+0000","last_clean":"2024-09-13T18:10:00.003653+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:10:00.003653+0000","last_undegraded":"2024-09-13T18:10:00.003653+0000","last_fullsized":"2024-09-13T18:10:00.003653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:10:00.003536+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:10:00.003536+0000","last_clean_scrub_stamp":"2024-09-13T18:10:00.003536+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:10.650450+0000","scrub_duration":0.0039536270000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:58.020529+0000","last_change":"2024-09-13T18:09:58.020529+0000","last_active":"2024-09-13T18:09:58.020529+0000","last_peered":"2024-09-13T18:09:58.020529+0000","last_clean":"2024-09-13T18:09:58.020529+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:58.020529+0000","last_undegraded":"2024-09-13T18:09:58.020529+0000","last_fullsized":"2024-09-13T18:09:58.020529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-09-13T18:09:58.020202+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-09-13T18:09:58.020202+0000","last_clean_scrub_stamp":"2024-09-13T18:09:58.020202+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:25.233099+0000","scrub_duration":0.003147567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:54.192064+0000","last_change":"2024-09-13T18:09:54.192064+0000","last_active":"2024-09-13T18:09:54.192064+0000","last_peered":"2024-09-13T18:09:54.192064+0000","last_clean":"2024-09-13T18:09:54.192064+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:54.192064+0000","last_undegraded":"2024-09-13T18:09:54.192064+0000","last_fullsized":"2024-09-13T18:09:54.192064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:54.191651+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:54.191651+0000","last_clean_scrub_stamp":"2024-09-13T18:09:54.191651+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:20.477813+0000","scrub_duration":0.0036660590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:55.073558+0000","last_change":"2024-09-13T18:09:55.073558+0000","last_active":"2024-09-13T18:09:55.073558+0000","last_peered":"2024-09-13T18:09:55.073558+0000","last_clean":"2024-09-13T18:09:55.073558+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:55.073558+0000","last_undegraded":"2024-09-13T18:09:55.073558+0000","last_fullsized":"2024-09-13T18:09:55.073558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'147","last_scrub_stamp":"2024-09-13T18:09:55.073264+0000","last_deep_scrub":"22'147","last_deep_scrub_stamp":"2024-09-13T18:09:55.073264+0000","last_clean_scrub_stamp":"2024-09-13T18:09:55.073264+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:40.207855+0000","scrub_duration":0.0037025220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:57.039369+0000","last_change":"2024-09-13T18:09:57.039369+0000","last_active":"2024-09-13T18:09:57.039369+0000","last_peered":"2024-09-13T18:09:57.039369+0000","last_clean":"2024-09-13T18:09:57.039369+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:57.039369+0000","last_undegraded":"2024-09-13T18:09:57.039369+0000","last_fullsized":"2024-09-13T18:09:57.039369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'146","last_scrub_stamp":"2024-09-13T18:09:57.038958+0000","last_deep_scrub":"22'146","last_deep_scrub_stamp":"2024-09-13T18:09:57.038958+0000","last_clean_scrub_stamp":"2024-09-13T18:09:57.038958+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:58.200730+0000","scrub_duration":0.0037464040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.585628+0000","last_change":"2024-09-13T18:09:42.585628+0000","last_active":"2024-09-13T18:09:42.585628+0000","last_peered":"2024-09-13T18:09:42.585628+0000","last_clean":"2024-09-13T18:09:42.585628+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:42.585628+0000","last_undegraded":"2024-09-13T18:09:42.585628+0000","last_fullsized":"2024-09-13T18:09:42.585628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.585326+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.780019+0000","scrub_duration":0.0035655249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.896465+0000","last_change":"2024-09-13T18:05:26.483882+0000","last_active":"2024-09-13T18:09:32.896465+0000","last_peered":"2024-09-13T18:09:32.896465+0000","last_clean":"2024-09-13T18:09:32.896465+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:09:32.896465+0000","last_undegraded":"2024-09-13T18:09:32.896465+0000","last_fullsized":"2024-09-13T18:09:32.896465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.563669+0000","last_change":"2024-09-13T18:09:47.563669+0000","last_active":"2024-09-13T18:09:47.563669+0000","last_peered":"2024-09-13T18:09:47.563669+0000","last_clean":"2024-09-13T18:09:47.563669+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:47.563669+0000","last_undegraded":"2024-09-13T18:09:47.563669+0000","last_fullsized":"2024-09-13T18:09:47.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'161","last_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_deep_scrub":"22'161","last_deep_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.563428+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:21.403749+0000","scrub_duration":0.0031339699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:54.975949+0000","last_change":"2024-09-13T18:09:54.975949+0000","last_active":"2024-09-13T18:09:54.975949+0000","last_peered":"2024-09-13T18:09:54.975949+0000","last_clean":"2024-09-13T18:09:54.975949+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:54.975949+0000","last_undegraded":"2024-09-13T18:09:54.975949+0000","last_fullsized":"2024-09-13T18:09:54.975949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'137","last_scrub_stamp":"2024-09-13T18:09:54.975660+0000","last_deep_scrub":"22'137","last_deep_scrub_stamp":"2024-09-13T18:09:54.975660+0000","last_clean_scrub_stamp":"2024-09-13T18:09:54.975660+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:47.283697+0000","scrub_duration":0.003384045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":192,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:02.083642+0000","last_change":"2024-09-13T18:10:02.083944+0000","last_active":"2024-09-13T18:10:02.083642+0000","last_peered":"2024-09-13T18:10:02.083642+0000","last_clean":"2024-09-13T18:10:02.083642+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:10:02.083642+0000","last_undegraded":"2024-09-13T18:10:02.083642+0000","last_fullsized":"2024-09-13T18:10:02.083642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'166","last_scrub_stamp":"2024-09-13T18:10:02.083533+0000","last_deep_scrub":"22'166","last_deep_scrub_stamp":"2024-09-13T18:10:02.083533+0000","last_clean_scrub_stamp":"2024-09-13T18:10:02.083533+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:26.318058+0000","scrub_duration":0.0036909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:56.968222+0000","last_change":"2024-09-13T18:09:56.968222+0000","last_active":"2024-09-13T18:09:56.968222+0000","last_peered":"2024-09-13T18:09:56.968222+0000","last_clean":"2024-09-13T18:09:56.968222+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:56.968222+0000","last_undegraded":"2024-09-13T18:09:56.968222+0000","last_fullsized":"2024-09-13T18:09:56.968222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:56.967906+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:56.967906+0000","last_clean_scrub_stamp":"2024-09-13T18:09:56.967906+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:55.306074+0000","scrub_duration":0.0034048479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":206,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.133440+0000","last_change":"2024-09-13T18:09:49.133717+0000","last_active":"2024-09-13T18:09:49.133440+0000","last_peered":"2024-09-13T18:09:49.133440+0000","last_clean":"2024-09-13T18:09:49.133440+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:49.133440+0000","last_undegraded":"2024-09-13T18:09:49.133440+0000","last_fullsized":"2024-09-13T18:09:49.133440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'180","last_scrub_stamp":"2024-09-13T18:09:49.133386+0000","last_deep_scrub":"22'180","last_deep_scrub_stamp":"2024-09-13T18:09:49.133386+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.133386+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:41.441423+0000","scrub_duration":0.0033144049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.843320+0000","last_change":"2024-09-13T18:09:45.843320+0000","last_active":"2024-09-13T18:09:45.843320+0000","last_peered":"2024-09-13T18:09:45.843320+0000","last_clean":"2024-09-13T18:09:45.843320+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:45.843320+0000","last_undegraded":"2024-09-13T18:09:45.843320+0000","last_fullsized":"2024-09-13T18:09:45.843320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.843044+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:01.372679+0000","scrub_duration":0.0036834659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":224,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:50.604514+0000","last_change":"2024-09-13T18:09:50.604737+0000","last_active":"2024-09-13T18:09:50.604514+0000","last_peered":"2024-09-13T18:09:50.604514+0000","last_clean":"2024-09-13T18:09:50.604514+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:50.604514+0000","last_undegraded":"2024-09-13T18:09:50.604514+0000","last_fullsized":"2024-09-13T18:09:50.604514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'198","last_scrub_stamp":"2024-09-13T18:09:50.604461+0000","last_deep_scrub":"22'198","last_deep_scrub_stamp":"2024-09-13T18:09:50.604461+0000","last_clean_scrub_stamp":"2024-09-13T18:09:50.604461+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:46.717159+0000","scrub_duration":0.0032810930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.177244+0000","last_change":"2024-09-13T18:09:51.177462+0000","last_active":"2024-09-13T18:09:51.177244+0000","last_peered":"2024-09-13T18:09:51.177244+0000","last_clean":"2024-09-13T18:09:51.177244+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:51.177244+0000","last_undegraded":"2024-09-13T18:09:51.177244+0000","last_fullsized":"2024-09-13T18:09:51.177244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:09:51.177192+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:09:51.177192+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.177192+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.693439+0000","scrub_duration":0.0033715429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.904114+0000","last_change":"2024-09-13T18:09:43.904114+0000","last_active":"2024-09-13T18:09:43.904114+0000","last_peered":"2024-09-13T18:09:43.904114+0000","last_clean":"2024-09-13T18:09:43.904114+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:43.904114+0000","last_undegraded":"2024-09-13T18:09:43.904114+0000","last_fullsized":"2024-09-13T18:09:43.904114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'133","last_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_deep_scrub":"22'133","last_deep_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.903836+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:16.160498+0000","scrub_duration":0.00391735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.031091+0000","last_change":"2024-09-13T18:09:48.031403+0000","last_active":"2024-09-13T18:09:48.031091+0000","last_peered":"2024-09-13T18:09:48.031091+0000","last_clean":"2024-09-13T18:09:48.031091+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:48.031091+0000","last_undegraded":"2024-09-13T18:09:48.031091+0000","last_fullsized":"2024-09-13T18:09:48.031091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'118","last_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_deep_scrub":"22'118","last_deep_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.030972+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:17.435633+0000","scrub_duration":0.0033291369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.106751+0000","last_change":"2024-09-13T18:09:51.106938+0000","last_active":"2024-09-13T18:09:51.106751+0000","last_peered":"2024-09-13T18:09:51.106751+0000","last_clean":"2024-09-13T18:09:51.106751+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:51.106751+0000","last_undegraded":"2024-09-13T18:09:51.106751+0000","last_fullsized":"2024-09-13T18:09:51.106751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:51.106699+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:51.106699+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.106699+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:19.935330+0000","scrub_duration":0.0036154820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.534744+0000","last_change":"2024-09-13T18:09:44.535039+0000","last_active":"2024-09-13T18:09:44.534744+0000","last_peered":"2024-09-13T18:09:44.534744+0000","last_clean":"2024-09-13T18:09:44.534744+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:44.534744+0000","last_undegraded":"2024-09-13T18:09:44.534744+0000","last_fullsized":"2024-09-13T18:09:44.534744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.534635+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:12.372830+0000","scrub_duration":0.0037670020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.561338+0000","last_change":"2024-09-13T18:09:51.561576+0000","last_active":"2024-09-13T18:09:51.561338+0000","last_peered":"2024-09-13T18:09:51.561338+0000","last_clean":"2024-09-13T18:09:51.561338+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:51.561338+0000","last_undegraded":"2024-09-13T18:09:51.561338+0000","last_fullsized":"2024-09-13T18:09:51.561338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-09-13T18:09:51.561284+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-09-13T18:09:51.561284+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.561284+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.829448+0000","scrub_duration":0.0034084549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.216608+0000","last_change":"2024-09-13T18:09:44.216871+0000","last_active":"2024-09-13T18:09:44.216608+0000","last_peered":"2024-09-13T18:09:44.216608+0000","last_clean":"2024-09-13T18:09:44.216608+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:44.216608+0000","last_undegraded":"2024-09-13T18:09:44.216608+0000","last_fullsized":"2024-09-13T18:09:44.216608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.216550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:41.980606+0000","scrub_duration":0.003700942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'8","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.935660+0000","last_change":"2024-09-13T18:09:30.935774+0000","last_active":"2024-09-13T18:09:30.935660+0000","last_peered":"2024-09-13T18:09:30.935660+0000","last_clean":"2024-09-13T18:09:30.935660+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:09:30.935660+0000","last_undegraded":"2024-09-13T18:09:30.935660+0000","last_fullsized":"2024-09-13T18:09:30.935660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'8","last_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_deep_scrub":"22'8","last_deep_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.935626+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:28.699682+0000","scrub_duration":0.0055564289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":162,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.170779+0000","last_change":"2024-09-13T18:09:42.170943+0000","last_active":"2024-09-13T18:09:42.170779+0000","last_peered":"2024-09-13T18:09:42.170779+0000","last_clean":"2024-09-13T18:09:42.170779+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:42.170779+0000","last_undegraded":"2024-09-13T18:09:42.170779+0000","last_fullsized":"2024-09-13T18:09:42.170779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'137","last_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_deep_scrub":"22'137","last_deep_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.170737+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:26.463444+0000","scrub_duration":0.0029453280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'4","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.778239+0000","last_change":"2024-09-13T18:09:32.778450+0000","last_active":"2024-09-13T18:09:32.778239+0000","last_peered":"2024-09-13T18:09:32.778239+0000","last_clean":"2024-09-13T18:09:32.778239+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:09:32.778239+0000","last_undegraded":"2024-09-13T18:09:32.778239+0000","last_fullsized":"2024-09-13T18:09:32.778239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.778184+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:36.981991+0000","scrub_duration":0.0058238919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.902060+0000","last_change":"2024-09-13T18:09:36.902293+0000","last_active":"2024-09-13T18:09:36.902060+0000","last_peered":"2024-09-13T18:09:36.902060+0000","last_clean":"2024-09-13T18:09:36.902060+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:09:36.902060+0000","last_undegraded":"2024-09-13T18:09:36.902060+0000","last_fullsized":"2024-09-13T18:09:36.902060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.902006+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.204839+0000","scrub_duration":0.006253906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":195,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:52.881317+0000","last_change":"2024-09-13T18:09:52.881541+0000","last_active":"2024-09-13T18:09:52.881317+0000","last_peered":"2024-09-13T18:09:52.881317+0000","last_clean":"2024-09-13T18:09:52.881317+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:52.881317+0000","last_undegraded":"2024-09-13T18:09:52.881317+0000","last_fullsized":"2024-09-13T18:09:52.881317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'170","last_scrub_stamp":"2024-09-13T18:09:52.881268+0000","last_deep_scrub":"22'170","last_deep_scrub_stamp":"2024-09-13T18:09:52.881268+0000","last_clean_scrub_stamp":"2024-09-13T18:09:52.881268+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:51.149431+0000","scrub_duration":0.0030826159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.208608+0000","last_change":"2024-09-13T18:09:37.208876+0000","last_active":"2024-09-13T18:09:37.208608+0000","last_peered":"2024-09-13T18:09:37.208608+0000","last_clean":"2024-09-13T18:09:37.208608+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:09:37.208608+0000","last_undegraded":"2024-09-13T18:09:37.208608+0000","last_fullsized":"2024-09-13T18:09:37.208608+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.208558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:40.391942+0000","scrub_duration":0.0030340900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.133597+0000","last_change":"2024-09-13T18:09:49.133895+0000","last_active":"2024-09-13T18:09:49.133597+0000","last_peered":"2024-09-13T18:09:49.133597+0000","last_clean":"2024-09-13T18:09:49.133597+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:49.133597+0000","last_undegraded":"2024-09-13T18:09:49.133597+0000","last_fullsized":"2024-09-13T18:09:49.133597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.133501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:03.638000+0000","scrub_duration":0.0029741580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'6","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.686704+0000","last_change":"2024-09-13T18:09:38.686942+0000","last_active":"2024-09-13T18:09:38.686704+0000","last_peered":"2024-09-13T18:09:38.686704+0000","last_clean":"2024-09-13T18:09:38.686704+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:09:38.686704+0000","last_undegraded":"2024-09-13T18:09:38.686704+0000","last_fullsized":"2024-09-13T18:09:38.686704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.686658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.524853+0000","scrub_duration":0.006664489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":254,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.179369+0000","last_change":"2024-09-13T18:09:33.179600+0000","last_active":"2024-09-13T18:09:33.179369+0000","last_peered":"2024-09-13T18:09:33.179369+0000","last_clean":"2024-09-13T18:09:33.179369+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:33.179369+0000","last_undegraded":"2024-09-13T18:09:33.179369+0000","last_fullsized":"2024-09-13T18:09:33.179369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'229","last_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_deep_scrub":"22'229","last_deep_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.179314+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.729956+0000","scrub_duration":0.0032080260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.189112+0000","last_change":"2024-09-13T18:09:36.189324+0000","last_active":"2024-09-13T18:09:36.189112+0000","last_peered":"2024-09-13T18:09:36.189112+0000","last_clean":"2024-09-13T18:09:36.189112+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:09:36.189112+0000","last_undegraded":"2024-09-13T18:09:36.189112+0000","last_fullsized":"2024-09-13T18:09:36.189112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.189056+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:20.481764+0000","scrub_duration":0.0058978600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":166,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.144751+0000","last_change":"2024-09-13T18:09:43.145140+0000","last_active":"2024-09-13T18:09:43.144751+0000","last_peered":"2024-09-13T18:09:43.144751+0000","last_clean":"2024-09-13T18:09:43.144751+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:43.144751+0000","last_undegraded":"2024-09-13T18:09:43.144751+0000","last_fullsized":"2024-09-13T18:09:43.144751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'141","last_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_deep_scrub":"22'141","last_deep_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.144592+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:46.327975+0000","scrub_duration":0.003201546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'12","reported_seq":38,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.124659+0000","last_change":"2024-09-13T18:09:42.124854+0000","last_active":"2024-09-13T18:09:42.124659+0000","last_peered":"2024-09-13T18:09:42.124659+0000","last_clean":"2024-09-13T18:09:42.124659+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:42.124659+0000","last_undegraded":"2024-09-13T18:09:42.124659+0000","last_fullsized":"2024-09-13T18:09:42.124659+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.124622+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.319315+0000","scrub_duration":0.0081039130000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.153755+0000","last_change":"2024-09-13T18:09:41.153755+0000","last_active":"2024-09-13T18:09:41.153755+0000","last_peered":"2024-09-13T18:09:41.153755+0000","last_clean":"2024-09-13T18:09:41.153755+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:41.153755+0000","last_undegraded":"2024-09-13T18:09:41.153755+0000","last_fullsized":"2024-09-13T18:09:41.153755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.153466+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:03.341358+0000","scrub_duration":0.0036038070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'98","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.723073+0000","last_change":"2024-09-13T18:09:36.723073+0000","last_active":"2024-09-13T18:09:36.723073+0000","last_peered":"2024-09-13T18:09:36.723073+0000","last_clean":"2024-09-13T18:09:36.723073+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:36.723073+0000","last_undegraded":"2024-09-13T18:09:36.723073+0000","last_fullsized":"2024-09-13T18:09:36.723073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'98","last_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_deep_scrub":"22'98","last_deep_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.722843+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:10.917536+0000","scrub_duration":0.0097799819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:06.217091+0000","last_change":"2024-09-13T18:10:06.217291+0000","last_active":"2024-09-13T18:10:06.217091+0000","last_peered":"2024-09-13T18:10:06.217091+0000","last_clean":"2024-09-13T18:10:06.217091+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:10:06.217091+0000","last_undegraded":"2024-09-13T18:10:06.217091+0000","last_fullsized":"2024-09-13T18:10:06.217091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-09-13T18:10:06.217035+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-09-13T18:10:06.217035+0000","last_clean_scrub_stamp":"2024-09-13T18:10:06.217035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:28.440213+0000","scrub_duration":0.0037585539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'10","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.076084+0000","last_change":"2024-09-13T18:09:30.076084+0000","last_active":"2024-09-13T18:09:30.076084+0000","last_peered":"2024-09-13T18:09:30.076084+0000","last_clean":"2024-09-13T18:09:30.076084+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:09:30.076084+0000","last_undegraded":"2024-09-13T18:09:30.076084+0000","last_fullsized":"2024-09-13T18:09:30.076084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_deep_scrub":"22'10","last_deep_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.075970+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:22.024885+0000","scrub_duration":0.0071596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.490414+0000","last_change":"2024-09-13T18:09:47.490666+0000","last_active":"2024-09-13T18:09:47.490414+0000","last_peered":"2024-09-13T18:09:47.490414+0000","last_clean":"2024-09-13T18:09:47.490414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:47.490414+0000","last_undegraded":"2024-09-13T18:09:47.490414+0000","last_fullsized":"2024-09-13T18:09:47.490414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.490364+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.759873+0000","scrub_duration":0.003581351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.125686+0000","last_change":"2024-09-13T18:09:48.125686+0000","last_active":"2024-09-13T18:09:48.125686+0000","last_peered":"2024-09-13T18:09:48.125686+0000","last_clean":"2024-09-13T18:09:48.125686+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:09:48.125686+0000","last_undegraded":"2024-09-13T18:09:48.125686+0000","last_fullsized":"2024-09-13T18:09:48.125686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:48.125424+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:48.125424+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.125424+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:16.882839+0000","scrub_duration":0.0056341389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:58.329511+0000","last_change":"2024-09-13T18:09:58.329511+0000","last_active":"2024-09-13T18:09:58.329511+0000","last_peered":"2024-09-13T18:09:58.329511+0000","last_clean":"2024-09-13T18:09:58.329511+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:58.329511+0000","last_undegraded":"2024-09-13T18:09:58.329511+0000","last_fullsized":"2024-09-13T18:09:58.329511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'171","last_scrub_stamp":"2024-09-13T18:09:58.329031+0000","last_deep_scrub":"22'171","last_deep_scrub_stamp":"2024-09-13T18:09:58.329031+0000","last_clean_scrub_stamp":"2024-09-13T18:09:58.329031+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:56.189225+0000","scrub_duration":0.00333746,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.573145+0000","last_change":"2024-09-13T18:09:41.573145+0000","last_active":"2024-09-13T18:09:41.573145+0000","last_peered":"2024-09-13T18:09:41.573145+0000","last_clean":"2024-09-13T18:09:41.573145+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:09:41.573145+0000","last_undegraded":"2024-09-13T18:09:41.573145+0000","last_fullsized":"2024-09-13T18:09:41.573145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.572829+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:03.842338+0000","scrub_duration":0.0068975479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.577331+0000","last_change":"2024-09-13T18:09:45.577331+0000","last_active":"2024-09-13T18:09:45.577331+0000","last_peered":"2024-09-13T18:09:45.577331+0000","last_clean":"2024-09-13T18:09:45.577331+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:45.577331+0000","last_undegraded":"2024-09-13T18:09:45.577331+0000","last_fullsized":"2024-09-13T18:09:45.577331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'165","last_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_deep_scrub":"22'165","last_deep_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.577074+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:39.093321+0000","scrub_duration":0.0035030899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.680306+0000","last_change":"2024-09-13T18:09:32.680306+0000","last_active":"2024-09-13T18:09:32.680306+0000","last_peered":"2024-09-13T18:09:32.680306+0000","last_clean":"2024-09-13T18:09:32.680306+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:09:32.680306+0000","last_undegraded":"2024-09-13T18:09:32.680306+0000","last_fullsized":"2024-09-13T18:09:32.680306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.680105+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:14.568207+0000","scrub_duration":0.013891555999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":215,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:56.298656+0000","last_change":"2024-09-13T18:09:56.298656+0000","last_active":"2024-09-13T18:09:56.298656+0000","last_peered":"2024-09-13T18:09:56.298656+0000","last_clean":"2024-09-13T18:09:56.298656+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:56.298656+0000","last_undegraded":"2024-09-13T18:09:56.298656+0000","last_fullsized":"2024-09-13T18:09:56.298656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-09-13T18:09:56.298218+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-09-13T18:09:56.298218+0000","last_clean_scrub_stamp":"2024-09-13T18:09:56.298218+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:51.415496+0000","scrub_duration":0.0039194690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.294830+0000","last_change":"2024-09-13T18:09:32.294830+0000","last_active":"2024-09-13T18:09:32.294830+0000","last_peered":"2024-09-13T18:09:32.294830+0000","last_clean":"2024-09-13T18:09:32.294830+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:09:32.294830+0000","last_undegraded":"2024-09-13T18:09:32.294830+0000","last_fullsized":"2024-09-13T18:09:32.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.294535+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:57.770286+0000","scrub_duration":0.0068459749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:57.285513+0000","last_change":"2024-09-13T18:09:57.285513+0000","last_active":"2024-09-13T18:09:57.285513+0000","last_peered":"2024-09-13T18:09:57.285513+0000","last_clean":"2024-09-13T18:09:57.285513+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:57.285513+0000","last_undegraded":"2024-09-13T18:09:57.285513+0000","last_fullsized":"2024-09-13T18:09:57.285513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'146","last_scrub_stamp":"2024-09-13T18:09:57.285356+0000","last_deep_scrub":"22'146","last_deep_scrub_stamp":"2024-09-13T18:09:57.285356+0000","last_clean_scrub_stamp":"2024-09-13T18:09:57.285356+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:07.932270+0000","scrub_duration":0.0029293700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.598029+0000","last_change":"2024-09-13T18:09:38.598029+0000","last_active":"2024-09-13T18:09:38.598029+0000","last_peered":"2024-09-13T18:09:38.598029+0000","last_clean":"2024-09-13T18:09:38.598029+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:09:38.598029+0000","last_undegraded":"2024-09-13T18:09:38.598029+0000","last_fullsized":"2024-09-13T18:09:38.598029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.597681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:42.801488+0000","scrub_duration":0.0054668370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.547319+0000","last_change":"2024-09-13T18:09:33.547319+0000","last_active":"2024-09-13T18:09:33.547319+0000","last_peered":"2024-09-13T18:09:33.547319+0000","last_clean":"2024-09-13T18:09:33.547319+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:33.547319+0000","last_undegraded":"2024-09-13T18:09:33.547319+0000","last_fullsized":"2024-09-13T18:09:33.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'138","last_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_deep_scrub":"22'138","last_deep_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.546894+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:32.849726+0000","scrub_duration":0.0035765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.150471+0000","last_change":"2024-09-13T18:09:38.150471+0000","last_active":"2024-09-13T18:09:38.150471+0000","last_peered":"2024-09-13T18:09:38.150471+0000","last_clean":"2024-09-13T18:09:38.150471+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:09:38.150471+0000","last_undegraded":"2024-09-13T18:09:38.150471+0000","last_fullsized":"2024-09-13T18:09:38.150471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.150113+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.914168+0000","scrub_duration":0.006034981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.907957+0000","last_change":"2024-09-13T18:05:26.491556+0000","last_active":"2024-09-13T18:09:31.907957+0000","last_peered":"2024-09-13T18:09:31.907957+0000","last_clean":"2024-09-13T18:09:31.907957+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:09:31.907957+0000","last_undegraded":"2024-09-13T18:09:31.907957+0000","last_fullsized":"2024-09-13T18:09:31.907957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.623881+0000","last_change":"2024-09-13T18:09:34.623881+0000","last_active":"2024-09-13T18:09:34.623881+0000","last_peered":"2024-09-13T18:09:34.623881+0000","last_clean":"2024-09-13T18:09:34.623881+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:09:34.623881+0000","last_undegraded":"2024-09-13T18:09:34.623881+0000","last_fullsized":"2024-09-13T18:09:34.623881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.623632+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.811523+0000","scrub_duration":0.0076832480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.504722+0000","last_change":"2024-09-13T18:09:36.504722+0000","last_active":"2024-09-13T18:09:36.504722+0000","last_peered":"2024-09-13T18:09:36.504722+0000","last_clean":"2024-09-13T18:09:36.504722+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:36.504722+0000","last_undegraded":"2024-09-13T18:09:36.504722+0000","last_fullsized":"2024-09-13T18:09:36.504722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.504299+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.659785+0000","scrub_duration":0.0035044780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.537687+0000","last_change":"2024-09-13T18:09:39.537874+0000","last_active":"2024-09-13T18:09:39.537687+0000","last_peered":"2024-09-13T18:09:39.537687+0000","last_clean":"2024-09-13T18:09:39.537687+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:09:39.537687+0000","last_undegraded":"2024-09-13T18:09:39.537687+0000","last_fullsized":"2024-09-13T18:09:39.537687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.537607+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:01.807117+0000","scrub_duration":0.0094788149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:35.176804+0000","last_change":"2024-09-13T18:09:35.176804+0000","last_active":"2024-09-13T18:09:35.176804+0000","last_peered":"2024-09-13T18:09:35.176804+0000","last_clean":"2024-09-13T18:09:35.176804+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:09:35.176804+0000","last_undegraded":"2024-09-13T18:09:35.176804+0000","last_fullsized":"2024-09-13T18:09:35.176804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_clean_scrub_stamp":"2024-09-13T18:09:35.176624+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:40.891116+0000","scrub_duration":0.0065320040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":181,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.504290+0000","last_change":"2024-09-13T18:09:49.504486+0000","last_active":"2024-09-13T18:09:49.504290+0000","last_peered":"2024-09-13T18:09:49.504290+0000","last_clean":"2024-09-13T18:09:49.504290+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:49.504290+0000","last_undegraded":"2024-09-13T18:09:49.504290+0000","last_fullsized":"2024-09-13T18:09:49.504290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'158","last_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_deep_scrub":"22'158","last_deep_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.504233+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:04.008733+0000","scrub_duration":0.0035247329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.470534+0000","last_change":"2024-09-13T18:09:41.470738+0000","last_active":"2024-09-13T18:09:41.470534+0000","last_peered":"2024-09-13T18:09:41.470534+0000","last_clean":"2024-09-13T18:09:41.470534+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:09:41.470534+0000","last_undegraded":"2024-09-13T18:09:41.470534+0000","last_fullsized":"2024-09-13T18:09:41.470534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.470474+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:55.974974+0000","scrub_duration":0.0059467979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.072172+0000","last_change":"2024-09-13T18:09:32.072172+0000","last_active":"2024-09-13T18:09:32.072172+0000","last_peered":"2024-09-13T18:09:32.072172+0000","last_clean":"2024-09-13T18:09:32.072172+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:32.072172+0000","last_undegraded":"2024-09-13T18:09:32.072172+0000","last_fullsized":"2024-09-13T18:09:32.072172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.071942+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:41.490052+0000","scrub_duration":0.0031235960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'12","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.594539+0000","last_change":"2024-09-13T18:09:40.594759+0000","last_active":"2024-09-13T18:09:40.594539+0000","last_peered":"2024-09-13T18:09:40.594539+0000","last_clean":"2024-09-13T18:09:40.594539+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:40.594539+0000","last_undegraded":"2024-09-13T18:09:40.594539+0000","last_fullsized":"2024-09-13T18:09:40.594539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.594477+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:33.040319+0000","scrub_duration":0.007660605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.079385+0000","last_change":"2024-09-13T18:09:44.079588+0000","last_active":"2024-09-13T18:09:44.079385+0000","last_peered":"2024-09-13T18:09:44.079385+0000","last_clean":"2024-09-13T18:09:44.079385+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:44.079385+0000","last_undegraded":"2024-09-13T18:09:44.079385+0000","last_fullsized":"2024-09-13T18:09:44.079385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.079336+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.917531+0000","scrub_duration":0.0030879660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.120445+0000","last_change":"2024-09-13T18:09:42.120682+0000","last_active":"2024-09-13T18:09:42.120445+0000","last_peered":"2024-09-13T18:09:42.120445+0000","last_clean":"2024-09-13T18:09:42.120445+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:09:42.120445+0000","last_undegraded":"2024-09-13T18:09:42.120445+0000","last_fullsized":"2024-09-13T18:09:42.120445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.120388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:11.525048+0000","scrub_duration":0.0039379339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.206072+0000","last_change":"2024-09-13T18:09:36.206072+0000","last_active":"2024-09-13T18:09:36.206072+0000","last_peered":"2024-09-13T18:09:36.206072+0000","last_clean":"2024-09-13T18:09:36.206072+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:36.206072+0000","last_undegraded":"2024-09-13T18:09:36.206072+0000","last_fullsized":"2024-09-13T18:09:36.206072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'145","last_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_deep_scrub":"22'145","last_deep_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.205813+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:46.067844+0000","scrub_duration":0.0034410579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.185425+0000","last_change":"2024-09-13T18:09:34.185425+0000","last_active":"2024-09-13T18:09:34.185425+0000","last_peered":"2024-09-13T18:09:34.185425+0000","last_clean":"2024-09-13T18:09:34.185425+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:09:34.185425+0000","last_undegraded":"2024-09-13T18:09:34.185425+0000","last_fullsized":"2024-09-13T18:09:34.185425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.185154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.373045+0000","scrub_duration":0.0028065149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:52.149646+0000","last_change":"2024-09-13T18:09:52.149955+0000","last_active":"2024-09-13T18:09:52.149646+0000","last_peered":"2024-09-13T18:09:52.149646+0000","last_clean":"2024-09-13T18:09:52.149646+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:52.149646+0000","last_undegraded":"2024-09-13T18:09:52.149646+0000","last_fullsized":"2024-09-13T18:09:52.149646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:52.149518+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:52.149518+0000","last_clean_scrub_stamp":"2024-09-13T18:09:52.149518+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.549523+0000","scrub_duration":0.0035626189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:46.350372+0000","last_change":"2024-09-13T18:09:46.350687+0000","last_active":"2024-09-13T18:09:46.350372+0000","last_peered":"2024-09-13T18:09:46.350372+0000","last_clean":"2024-09-13T18:09:46.350372+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:09:46.350372+0000","last_undegraded":"2024-09-13T18:09:46.350372+0000","last_fullsized":"2024-09-13T18:09:46.350372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_clean_scrub_stamp":"2024-09-13T18:09:46.350302+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:12.636464+0000","scrub_duration":0.0071307339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.119801+0000","last_change":"2024-09-13T18:09:47.120009+0000","last_active":"2024-09-13T18:09:47.119801+0000","last_peered":"2024-09-13T18:09:47.119801+0000","last_clean":"2024-09-13T18:09:47.119801+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:47.119801+0000","last_undegraded":"2024-09-13T18:09:47.119801+0000","last_fullsized":"2024-09-13T18:09:47.119801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.119752+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.389262+0000","scrub_duration":0.0031522669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.236451+0000","last_change":"2024-09-13T18:09:33.236451+0000","last_active":"2024-09-13T18:09:33.236451+0000","last_peered":"2024-09-13T18:09:33.236451+0000","last_clean":"2024-09-13T18:09:33.236451+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:33.236451+0000","last_undegraded":"2024-09-13T18:09:33.236451+0000","last_fullsized":"2024-09-13T18:09:33.236451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.236168+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:32.316160+0000","scrub_duration":0.0077651450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.916418+0000","last_change":"2024-09-13T18:09:42.916418+0000","last_active":"2024-09-13T18:09:42.916418+0000","last_peered":"2024-09-13T18:09:42.916418+0000","last_clean":"2024-09-13T18:09:42.916418+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:42.916418+0000","last_undegraded":"2024-09-13T18:09:42.916418+0000","last_fullsized":"2024-09-13T18:09:42.916418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.915992+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:05.185502+0000","scrub_duration":0.0037716170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.710102+0000","last_change":"2024-09-13T18:09:34.710102+0000","last_active":"2024-09-13T18:09:34.710102+0000","last_peered":"2024-09-13T18:09:34.710102+0000","last_clean":"2024-09-13T18:09:34.710102+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:09:34.710102+0000","last_undegraded":"2024-09-13T18:09:34.710102+0000","last_fullsized":"2024-09-13T18:09:34.710102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.709622+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:27.155464+0000","scrub_duration":0.006819388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.111012+0000","last_change":"2024-09-13T18:09:37.111012+0000","last_active":"2024-09-13T18:09:37.111012+0000","last_peered":"2024-09-13T18:09:37.111012+0000","last_clean":"2024-09-13T18:09:37.111012+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:37.111012+0000","last_undegraded":"2024-09-13T18:09:37.111012+0000","last_fullsized":"2024-09-13T18:09:37.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.110762+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:59.856602+0000","scrub_duration":0.0030931550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.353833+0000","last_change":"2024-09-13T18:09:48.353833+0000","last_active":"2024-09-13T18:09:48.353833+0000","last_peered":"2024-09-13T18:09:48.353833+0000","last_clean":"2024-09-13T18:09:48.353833+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:09:48.353833+0000","last_undegraded":"2024-09-13T18:09:48.353833+0000","last_fullsized":"2024-09-13T18:09:48.353833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.353503+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:44.466201+0000","scrub_duration":0.0064759630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.166659+0000","last_change":"2024-09-13T18:09:39.166659+0000","last_active":"2024-09-13T18:09:39.166659+0000","last_peered":"2024-09-13T18:09:39.166659+0000","last_clean":"2024-09-13T18:09:39.166659+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:39.166659+0000","last_undegraded":"2024-09-13T18:09:39.166659+0000","last_fullsized":"2024-09-13T18:09:39.166659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.166391+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:21.054493+0000","scrub_duration":0.003674783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.194698+0000","last_change":"2024-09-13T18:09:30.194698+0000","last_active":"2024-09-13T18:09:30.194698+0000","last_peered":"2024-09-13T18:09:30.194698+0000","last_clean":"2024-09-13T18:09:30.194698+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:09:30.194698+0000","last_undegraded":"2024-09-13T18:09:30.194698+0000","last_fullsized":"2024-09-13T18:09:30.194698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.194421+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.647061+0000","scrub_duration":0.0066843090000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.866987+0000","last_change":"2024-09-13T18:09:44.866987+0000","last_active":"2024-09-13T18:09:44.866987+0000","last_peered":"2024-09-13T18:09:44.866987+0000","last_clean":"2024-09-13T18:09:44.866987+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:44.866987+0000","last_undegraded":"2024-09-13T18:09:44.866987+0000","last_fullsized":"2024-09-13T18:09:44.866987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'153","last_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_deep_scrub":"22'153","last_deep_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.866743+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:02.632323+0000","scrub_duration":0.0035320389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.124356+0000","last_change":"2024-09-13T18:09:40.124356+0000","last_active":"2024-09-13T18:09:40.124356+0000","last_peered":"2024-09-13T18:09:40.124356+0000","last_clean":"2024-09-13T18:09:40.124356+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:09:40.124356+0000","last_undegraded":"2024-09-13T18:09:40.124356+0000","last_fullsized":"2024-09-13T18:09:40.124356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.124055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:32.569897+0000","scrub_duration":0.0056691459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.894782+0000","last_change":"2024-09-13T18:09:51.894782+0000","last_active":"2024-09-13T18:09:51.894782+0000","last_peered":"2024-09-13T18:09:51.894782+0000","last_clean":"2024-09-13T18:09:51.894782+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:51.894782+0000","last_undegraded":"2024-09-13T18:09:51.894782+0000","last_fullsized":"2024-09-13T18:09:51.894782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:51.894360+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:51.894360+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.894360+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:48.007058+0000","scrub_duration":0.003071126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.367333+0000","last_change":"2024-09-13T18:09:45.367333+0000","last_active":"2024-09-13T18:09:45.367333+0000","last_peered":"2024-09-13T18:09:45.367333+0000","last_clean":"2024-09-13T18:09:45.367333+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:09:45.367333+0000","last_undegraded":"2024-09-13T18:09:45.367333+0000","last_fullsized":"2024-09-13T18:09:45.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.367056+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:19.207376+0000","scrub_duration":0.0060695089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.607128+0000","last_change":"2024-09-13T18:09:48.607128+0000","last_active":"2024-09-13T18:09:48.607128+0000","last_peered":"2024-09-13T18:09:48.607128+0000","last_clean":"2024-09-13T18:09:48.607128+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:48.607128+0000","last_undegraded":"2024-09-13T18:09:48.607128+0000","last_fullsized":"2024-09-13T18:09:48.607128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'128","last_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_deep_scrub":"22'128","last_deep_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.606859+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:14.893021+0000","scrub_duration":0.0029830960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":208,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:03.035771+0000","last_change":"2024-09-13T18:10:03.036002+0000","last_active":"2024-09-13T18:10:03.035771+0000","last_peered":"2024-09-13T18:10:03.035771+0000","last_clean":"2024-09-13T18:10:03.035771+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:10:03.035771+0000","last_undegraded":"2024-09-13T18:10:03.035771+0000","last_fullsized":"2024-09-13T18:10:03.035771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'183","last_scrub_stamp":"2024-09-13T18:10:03.035721+0000","last_deep_scrub":"22'183","last_deep_scrub_stamp":"2024-09-13T18:10:03.035721+0000","last_clean_scrub_stamp":"2024-09-13T18:10:03.035721+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:41.242647+0000","scrub_duration":0.0030275829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.447885+0000","last_change":"2024-09-13T18:09:43.448186+0000","last_active":"2024-09-13T18:09:43.447885+0000","last_peered":"2024-09-13T18:09:43.447885+0000","last_clean":"2024-09-13T18:09:43.447885+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:09:43.447885+0000","last_undegraded":"2024-09-13T18:09:43.447885+0000","last_fullsized":"2024-09-13T18:09:43.447885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.447804+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:36.964051+0000","scrub_duration":0.0057891319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":155,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:20.246030+0000","last_change":"2024-09-13T18:05:26.492414+0000","last_active":"2024-09-13T18:09:20.246030+0000","last_peered":"2024-09-13T18:09:20.246030+0000","last_clean":"2024-09-13T18:09:20.246030+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:09:20.246030+0000","last_undegraded":"2024-09-13T18:09:20.246030+0000","last_fullsized":"2024-09-13T18:09:20.246030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:05:26.086173+0000","last_clean_scrub_stamp":"2024-09-13T18:05:26.086173+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'7","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.302186+0000","last_change":"2024-09-13T18:09:53.302413+0000","last_active":"2024-09-13T18:09:53.302186+0000","last_peered":"2024-09-13T18:09:53.302186+0000","last_clean":"2024-09-13T18:09:53.302186+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:09:53.302186+0000","last_undegraded":"2024-09-13T18:09:53.302186+0000","last_fullsized":"2024-09-13T18:09:53.302186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:53.302131+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:53.302131+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.302131+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:51.640299+0000","scrub_duration":0.0070899999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.997146+0000","last_change":"2024-09-13T18:09:53.997407+0000","last_active":"2024-09-13T18:09:53.997146+0000","last_peered":"2024-09-13T18:09:53.997146+0000","last_clean":"2024-09-13T18:09:53.997146+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:53.997146+0000","last_undegraded":"2024-09-13T18:09:53.997146+0000","last_fullsized":"2024-09-13T18:09:53.997146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:09:53.997095+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:09:53.997095+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.997095+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:22.754510+0000","scrub_duration":0.0036090340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.898069+0000","last_change":"2024-09-13T18:09:39.898399+0000","last_active":"2024-09-13T18:09:39.898069+0000","last_peered":"2024-09-13T18:09:39.898069+0000","last_clean":"2024-09-13T18:09:39.898069+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:09:39.898069+0000","last_undegraded":"2024-09-13T18:09:39.898069+0000","last_fullsized":"2024-09-13T18:09:39.898069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.897960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.053446+0000","scrub_duration":0.0032269820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.907452+0000","last_change":"2024-09-13T18:09:48.907691+0000","last_active":"2024-09-13T18:09:48.907452+0000","last_peered":"2024-09-13T18:09:48.907452+0000","last_clean":"2024-09-13T18:09:48.907452+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:48.907452+0000","last_undegraded":"2024-09-13T18:09:48.907452+0000","last_fullsized":"2024-09-13T18:09:48.907452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'152","last_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_deep_scrub":"22'152","last_deep_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.907399+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:15.193562+0000","scrub_duration":0.0033935720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'13","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.063246+0000","last_change":"2024-09-13T18:09:31.063246+0000","last_active":"2024-09-13T18:09:31.063246+0000","last_peered":"2024-09-13T18:09:31.063246+0000","last_clean":"2024-09-13T18:09:31.063246+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:09:31.063246+0000","last_undegraded":"2024-09-13T18:09:31.063246+0000","last_fullsized":"2024-09-13T18:09:31.063246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_clean_scrub_stamp":"2024-09-13T18:09:31.063128+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:51.931136+0000","scrub_duration":0.0086318439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":285,"ondisk_log_size":285,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509502,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60799999999999998,"15min":0.65800000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.30399999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.85399999999999998,"5min":1.097,"15min":1.097},"last":0.68600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.75600000000000001,"15min":0.73999999999999999},"min":{"1min":0.41399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.0230000000000001,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.78200000000000003},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":3.0510000000000002,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.66900000000000004},"min":{"1min":0.42499999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.139,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.85699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.84899999999999998,"15min":0.88100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1120000000000001,"5min":1.516,"15min":1.516},"last":0.70899999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.59099999999999997,"5min":0.499,"15min":0.499},"max":{"1min":3.7919999999999998,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.236},{"interface":"front","average":{"1min":1.012,"5min":0.96699999999999997,"15min":1.0129999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":3.4049999999999998,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.995}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.92300000000000004,"15min":0.98699999999999999},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2330000000000001,"5min":1.907,"15min":1.907},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.048,"15min":1.0980000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":3.1720000000000002,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":1.286}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.998,"15min":1.077},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4279999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.081},{"interface":"front","average":{"1min":1.167,"5min":1.024,"15min":1.05},"min":{"1min":0.60499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.4539999999999997,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":0.97299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58899999999999997,"15min":0.629},"min":{"1min":0.26500000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.92600000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.60199999999999998,"15min":0.66200000000000003},"min":{"1min":0.30099999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.58999999999999997,"15min":0.622},"min":{"1min":0.27600000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.73999999999999999,"5min":2.077,"15min":2.077},"last":0.755},{"interface":"front","average":{"1min":1.1910000000000001,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.35699999999999998,"5min":0.246,"15min":0.246},"max":{"1min":11.384,"5min":11.384,"15min":11.384},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.80900000000000005},"min":{"1min":0.33700000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.9450000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71299999999999997,"15min":0.749},"min":{"1min":0.317,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":2.7229999999999999,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93200000000000005,"15min":0.94199999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.4590000000000001,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.93799999999999994,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.181,"5min":1.347,"15min":1.347},"last":1.1639999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.98599999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.319,"5min":1.452,"15min":1.452},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.94099999999999995,"15min":0.98699999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.0129999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":1.006,"15min":1.095},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1990000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.222},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97799999999999998,"15min":1.0389999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.222,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.032}]},{"osd":7,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.377,"5min":1.46,"15min":1.46},"last":1.097},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0800000000000001}]}]},{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.46400000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1419999999999999,"5min":1.232,"15min":1.232},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.91000000000000003,"15min":1.0369999999999999},"min":{"1min":0.45100000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.49,"5min":6.093,"15min":6.093},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":1.0169999999999999,"15min":1.1479999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.5349999999999999,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.90200000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.79200000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":0.84599999999999997,"15min":0.84099999999999997},"min":{"1min":0.56699999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.149,"5min":1.0509999999999999,"15min":1.161},"min":{"1min":0.77400000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":3.0680000000000001,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":0.76800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":0.90100000000000002,"15min":0.85499999999999998},"min":{"1min":0.61099999999999999,"5min":0.435,"15min":0.435},"max":{"1min":5.798,"5min":5.798,"15min":5.798},"last":1.038},{"interface":"front","average":{"1min":1.264,"5min":0.99199999999999999,"15min":0.98399999999999999},"min":{"1min":0.58599999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.7670000000000003,"5min":5.7670000000000003,"15min":5.7670000000000003},"last":1.1200000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94599999999999995,"15min":0.97799999999999998},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3420000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.25,"5min":1.161,"15min":1.2729999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":5.8230000000000004,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.1519999999999999,"15min":1.252},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.9470000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.236,"5min":1.1830000000000001,"15min":1.2869999999999999},"min":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":5.8440000000000003,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":1.0740000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:09:25 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2949999999999999,"15min":1.4450000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":5.7359999999999998,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.123,"15min":1.2110000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":5.8689999999999998,"5min":5.8689999999999998,"15min":5.8689999999999998},"last":1.0920000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1899999999999999,"5min":1.286,"15min":1.286},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.82699999999999996,"15min":0.79300000000000004},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":0.88900000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.84199999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":0.89100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.23,"5min":0.997,"15min":0.96199999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":5.9160000000000004,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.90400000000000003,"15min":0.95199999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.121,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.89700000000000002,"5min":1.0269999999999999,"15min":1.0289999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.2789999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.748}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.0149999999999999,"15min":1.022},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5329999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.87},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0429999999999999,"15min":1.0589999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.859,"5min":1.859,"15min":1.859},"last":0.96399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.1659999999999999,"15min":1.091},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":7.069,"5min":7.069,"15min":7.069},"last":0.77800000000000002},{"interface":"front","average":{"1min":1.048,"5min":1.097,"15min":1.1259999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.552,"5min":1.621,"15min":1.621},"last":1.014}]}]},{"osd":4,"up_from":14,"seq":60129542205,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0940000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.82199999999999995,"15min":0.879},"min":{"1min":0.44800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93700000000000006,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.91600000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.075,"5min":3.194,"15min":3.194},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.599,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.0009999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91100000000000003,"15min":0.95499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6000000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6279999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.873},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.93600000000000005,"15min":0.97499999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1859999999999999,"5min":3.125,"15min":3.125},"last":1.0449999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.91500000000000004,"15min":1.002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1930000000000001,"5min":1.909,"15min":1.909},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0509999999999999,"15min":1.105},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.679,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.091}]},{"osd":6,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98299999999999998,"15min":1.0429999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.872,"5min":1.0069999999999999,"15min":1.075},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2410000000000001,"5min":1.885,"15min":1.885},"last":0.97499999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.083,"15min":1.149},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0760000000000001,"15min":1.165},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3560000000000001,"5min":1.851,"15min":1.851},"last":1.115}]}]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.90000000000000002,"5min":1.226,"15min":1.226},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.9079999999999999,"5min":2.9079999999999999,"15min":2.9079999999999999},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.79800000000000004,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.7729999999999997,"5min":4.7729999999999997,"15min":4.7729999999999997},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.75},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0469999999999999,"5min":1.798,"15min":1.798},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.88100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.359,"15min":1.359},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.232}]},{"osd":5,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.96699999999999997},"min":{"1min":0.50600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2629999999999999,"5min":1.905,"15min":1.905},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.95099999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2190000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.91900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.085,"15min":1.0960000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.012,"15min":1.0589999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.2569999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98699999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.198,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.343}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43640,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":43390,"kb_avail":94328200,"statfs":{"total":96636764160,"available":96592076800,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":44431814},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":0.86199999999999999},"min":{"1min":0.35399999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.1359999999999999,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.03},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.753,"15min":0.77600000000000002},"min":{"1min":0.48399999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2210000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.90200000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86199999999999999,"15min":0.83999999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.1520000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.94499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0600000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61399999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89700000000000002,"15min":0.92300000000000004},"min":{"1min":0.65100000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.93899999999999995,"15min":0.89300000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.1059999999999999,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.872}]},{"osd":4,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.85499999999999998,"15min":0.91500000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.169,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.91600000000000004,"15min":0.96599999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1559999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.93500000000000005,"15min":0.93300000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.2160000000000002,"5min":3.242,"15min":3.242},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.98499999999999999,"15min":1.032},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.1140000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:09:22 2024","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0169999999999999,"15min":1.075},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0569999999999999,"15min":1.0609999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.1840000000000002,"5min":3.343,"15min":3.343},"last":0.92900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.0720000000000001,"5min":1.214,"15min":1.214},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.83499999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70999999999999996,"15min":0.75800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.107,"5min":2.27,"15min":2.27},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.78800000000000003},"min":{"1min":0.376,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.73799999999999999,"15min":0.78800000000000003},"min":{"1min":0.436,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0049999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.85999999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.89600000000000002,"15min":0.95799999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.175,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94699999999999995,"15min":0.95699999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.252,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":1.0269999999999999,"15min":1.0329999999999999},"min":{"1min":0.58199999999999996,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.3540000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.99099999999999999,"15min":1.0529999999999999},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.4350000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.042}]},{"osd":6,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.048,"15min":1.1000000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.4590000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0940000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.639,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":1.1000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:09:23 2024","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.99099999999999999,"15min":1.069},"min":{"1min":0.59699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.417,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.1359999999999999,"15min":1.1830000000000001},"min":{"1min":0.60299999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":3.5910000000000002,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.395}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:10:14.036 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.036 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.036 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.036 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.037 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.037 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.038 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-13T18:05:26.086173+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=5, tm_sec=26, tm_wday=4, tm_yday=257, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=13, tm_hour=18, tm_min=9, tm_sec=27, tm_wday=4, tm_yday=257, tm_isdst=0) 2024-09-13T18:10:14.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-13T18:10:34.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:10:34.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 Processor -- start 2024-09-13T18:10:34.161 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 -- start start 2024-09-13T18:10:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0500c3130 0x7ff0500c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c14d0 0x7ff0500c3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.163 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500c3870 con 0x7ff0500c2d50 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff050156540 con 0x7ff0500c3130 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050156820 con 0x7ff0500c14d0 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0500c3130 0x7ff0500c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0500c3130 0x7ff0500c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41228/0 (socket says 172.21.15.88:41228) 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 -- 172.21.15.88:0/2886138103 learned_addr learned my addr 172.21.15.88:0/2886138103 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04effd700 1 --1- 172.21.15.88:0/2886138103 >> v1:172.21.15.88:6789/0 conn(0x7ff0500c2d50 0x7ff050155a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54280/0 (socket says 172.21.15.88:54280) 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04f7fe700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c14d0 0x7ff0500c3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 -- 172.21.15.88:0/2886138103 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c14d0 msgr2=0x7ff0500c3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c14d0 0x7ff0500c3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 -- 172.21.15.88:0/2886138103 >> v1:172.21.15.88:6789/0 conn(0x7ff0500c2d50 legacy=0x7ff050155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.157+0000 7ff04e7fc700 1 -- 172.21.15.88:0/2886138103 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500c52a0 con 0x7ff0500c3130 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04e7fc700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c3130 0x7ff0500c5d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff040009910 tx=0x7ff040009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73e7d22121beeb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.164 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04dffb700 1 -- 172.21.15.88:0/2886138103 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000ba60 con 0x7ff0500c3130 2024-09-13T18:10:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04dffb700 1 -- 172.21.15.88:0/2886138103 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000bbc0 con 0x7ff0500c3130 2024-09-13T18:10:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04dffb700 1 -- 172.21.15.88:0/2886138103 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040009e60 con 0x7ff0500c3130 2024-09-13T18:10:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- 172.21.15.88:0/2886138103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c3130 msgr2=0x7ff0500c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.165 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c3130 0x7ff0500c5d80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff040009910 tx=0x7ff040009c20 comp rx=0 tx=0).stop 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- 172.21.15.88:0/2886138103 shutdown_connections 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c14d0 0x7ff0500c3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 --2- 172.21.15.88:0/2886138103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c3130 0x7ff0500c5d80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- 172.21.15.88:0/2886138103 >> 172.21.15.88:0/2886138103 conn(0x7ff050066940 msgr2=0x7ff05006eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- 172.21.15.88:0/2886138103 shutdown_connections 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- 172.21.15.88:0/2886138103 wait complete. 2024-09-13T18:10:34.166 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 Processor -- start 2024-09-13T18:10:34.167 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.161+0000 7ff04ffff700 1 -- start start 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0500c14d0 0x7ff0501ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c3130 0x7ff050144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050146db0 con 0x7ff0500c2d50 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05006db90 con 0x7ff0500c14d0 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050145a20 con 0x7ff0500c3130 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41240/0 (socket says 172.21.15.88:41240) 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 -- 172.21.15.88:0/1514977464 learned_addr learned my addr 172.21.15.88:0/1514977464 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04effd700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0500c14d0 0x7ff0501ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04f7fe700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c3130 0x7ff050144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.170 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 -- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c3130 msgr2=0x7ff050144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c3130 0x7ff050144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 -- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0500c14d0 msgr2=0x7ff0501ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0500c14d0 0x7ff0501ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 -- 172.21.15.88:0/1514977464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009570 con 0x7ff0500c2d50 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04e7fc700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff040014040 tx=0x7ff040004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040004310 con 0x7ff0500c2d50 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04001e070 con 0x7ff0500c2d50 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0400036c0 con 0x7ff0500c2d50 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff050145d00 con 0x7ff0500c2d50 2024-09-13T18:10:34.171 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.165+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0501462c0 con 0x7ff0500c2d50 2024-09-13T18:10:34.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050144290 con 0x7ff0500c2d50 2024-09-13T18:10:34.172 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7ff040020030 con 0x7ff0500c2d50 2024-09-13T18:10:34.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff0377fe700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 0x7ff03c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff040085130 con 0x7ff0500c2d50 2024-09-13T18:10:34.173 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff04effd700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 0x7ff03c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.174 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.169+0000 7ff04effd700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 0x7ff03c068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff044000f60 tx=0x7ff044007ef0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.177 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.173+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7ff050144290 con 0x7ff0500c2d50 2024-09-13T18:10:34.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.341+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 --> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0500c7e60 con 0x7ff03c066730 2024-09-13T18:10:34.362 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.357+0000 7ff0377fe700 1 -- 172.21.15.88:0/1514977464 <== mgr.4098 v2:172.21.15.94:6832/2322387369 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+291424 (secure 0 0 0) 0x7ff0500c7e60 con 0x7ff03c066730 2024-09-13T18:10:34.366 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:10:34.368 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 msgr2=0x7ff03c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 0x7ff03c068bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff044000f60 tx=0x7ff044007ef0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 msgr2=0x7ff05014e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff040014040 tx=0x7ff040004770 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 shutdown_connections 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7ff03c066730 0x7ff03c068bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0500c3130 0x7ff050144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0500c2d50 0x7ff05014e570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 --2- 172.21.15.88:0/1514977464 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0500c14d0 0x7ff0501ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 >> 172.21.15.88:0/1514977464 conn(0x7ff050066940 msgr2=0x7ff0500c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 shutdown_connections 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.361+0000 7ff04ffff700 1 -- 172.21.15.88:0/1514977464 wait complete. 2024-09-13T18:10:34.369 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-09-13T18:10:34.384 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":173,"stamp":"2024-09-13T18:10:33.067567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":812478,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":121,"num_read_kb":105,"num_write":9630,"num_write_kb":25168550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10121,"ondisk_log_size":10121,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":284128,"kb_used_data":2464,"kb_used_omap":12,"kb_used_meta":281587,"kb_avail":754690592,"statfs":{"total":773094113280,"available":772803166208,"internally_reserved":0,"allocated":2523136,"data_stored":2275692,"data_compressed":69810,"data_compressed_allocated":98304,"data_compressed_original":1163264,"omap_allocated":12744,"internal_metadata":288345656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004528"},"pg_stats":[{"pgid":"3.3f","version":"22'146","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:15.155495+0000","last_change":"2024-09-13T18:10:15.155692+0000","last_active":"2024-09-13T18:10:15.155495+0000","last_peered":"2024-09-13T18:10:15.155495+0000","last_clean":"2024-09-13T18:10:15.155495+0000","last_became_active":"2024-09-13T18:05:26.497527+0000","last_became_peered":"2024-09-13T18:05:26.497527+0000","last_unstale":"2024-09-13T18:10:15.155495+0000","last_undegraded":"2024-09-13T18:10:15.155495+0000","last_fullsized":"2024-09-13T18:10:15.155495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'146","last_scrub_stamp":"2024-09-13T18:10:15.155430+0000","last_deep_scrub":"22'146","last_deep_scrub_stamp":"2024-09-13T18:10:15.155430+0000","last_clean_scrub_stamp":"2024-09-13T18:10:15.155430+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:15:29.049773+0000","scrub_duration":0.0041955309999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"22'130","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.162407+0000","last_change":"2024-09-13T18:09:53.162596+0000","last_active":"2024-09-13T18:09:53.162407+0000","last_peered":"2024-09-13T18:09:53.162407+0000","last_clean":"2024-09-13T18:09:53.162407+0000","last_became_active":"2024-09-13T18:05:26.486347+0000","last_became_peered":"2024-09-13T18:05:26.486347+0000","last_unstale":"2024-09-13T18:09:53.162407+0000","last_undegraded":"2024-09-13T18:09:53.162407+0000","last_fullsized":"2024-09-13T18:09:53.162407+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-09-13T18:09:53.162357+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-09-13T18:09:53.162357+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.162357+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:27.002678+0000","scrub_duration":0.00337828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.150698+0000","last_change":"2024-09-13T18:09:41.150927+0000","last_active":"2024-09-13T18:09:41.150698+0000","last_peered":"2024-09-13T18:09:41.150698+0000","last_clean":"2024-09-13T18:09:41.150698+0000","last_became_active":"2024-09-13T18:05:26.482708+0000","last_became_peered":"2024-09-13T18:05:26.482708+0000","last_unstale":"2024-09-13T18:09:41.150698+0000","last_undegraded":"2024-09-13T18:09:41.150698+0000","last_fullsized":"2024-09-13T18:09:41.150698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:41.150650+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.150650+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:46.865142+0000","scrub_duration":0.0032251630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"22'173","reported_seq":199,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:11.948030+0000","last_change":"2024-09-13T18:10:11.948247+0000","last_active":"2024-09-13T18:10:11.948030+0000","last_peered":"2024-09-13T18:10:11.948030+0000","last_clean":"2024-09-13T18:10:11.948030+0000","last_became_active":"2024-09-13T18:05:26.493312+0000","last_became_peered":"2024-09-13T18:05:26.493312+0000","last_unstale":"2024-09-13T18:10:11.948030+0000","last_undegraded":"2024-09-13T18:10:11.948030+0000","last_fullsized":"2024-09-13T18:10:11.948030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'173","last_scrub_stamp":"2024-09-13T18:10:11.947971+0000","last_deep_scrub":"22'173","last_deep_scrub_stamp":"2024-09-13T18:10:11.947971+0000","last_clean_scrub_stamp":"2024-09-13T18:10:11.947971+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:10.568343+0000","scrub_duration":0.003748407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"22'148","reported_seq":174,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:12.252740+0000","last_change":"2024-09-13T18:10:12.252740+0000","last_active":"2024-09-13T18:10:12.252740+0000","last_peered":"2024-09-13T18:10:12.252740+0000","last_clean":"2024-09-13T18:10:12.252740+0000","last_became_active":"2024-09-13T18:05:26.487664+0000","last_became_peered":"2024-09-13T18:05:26.487664+0000","last_unstale":"2024-09-13T18:10:12.252740+0000","last_undegraded":"2024-09-13T18:10:12.252740+0000","last_fullsized":"2024-09-13T18:10:12.252740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'148","last_scrub_stamp":"2024-09-13T18:10:12.252327+0000","last_deep_scrub":"22'148","last_deep_scrub_stamp":"2024-09-13T18:10:12.252327+0000","last_clean_scrub_stamp":"2024-09-13T18:10:12.252327+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:28:32.865490+0000","scrub_duration":0.00375714,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:12.976052+0000","last_change":"2024-09-13T18:10:12.976052+0000","last_active":"2024-09-13T18:10:12.976052+0000","last_peered":"2024-09-13T18:10:12.976052+0000","last_clean":"2024-09-13T18:10:12.976052+0000","last_became_active":"2024-09-13T18:05:26.494539+0000","last_became_peered":"2024-09-13T18:05:26.494539+0000","last_unstale":"2024-09-13T18:10:12.976052+0000","last_undegraded":"2024-09-13T18:10:12.976052+0000","last_fullsized":"2024-09-13T18:10:12.976052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:10:12.975793+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:10:12.975793+0000","last_clean_scrub_stamp":"2024-09-13T18:10:12.975793+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:14:20.786539+0000","scrub_duration":0.003880831,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"22'164","reported_seq":190,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:00.281176+0000","last_change":"2024-09-13T18:10:00.281176+0000","last_active":"2024-09-13T18:10:00.281176+0000","last_peered":"2024-09-13T18:10:00.281176+0000","last_clean":"2024-09-13T18:10:00.281176+0000","last_became_active":"2024-09-13T18:05:26.487971+0000","last_became_peered":"2024-09-13T18:05:26.487971+0000","last_unstale":"2024-09-13T18:10:00.281176+0000","last_undegraded":"2024-09-13T18:10:00.281176+0000","last_fullsized":"2024-09-13T18:10:00.281176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'164","last_scrub_stamp":"2024-09-13T18:10:00.280730+0000","last_deep_scrub":"22'164","last_deep_scrub_stamp":"2024-09-13T18:10:00.280730+0000","last_clean_scrub_stamp":"2024-09-13T18:10:00.280730+0000","objects_scrubbed":0,"log_size":164,"log_dups_size":0,"ondisk_log_size":164,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:16.548461+0000","scrub_duration":0.0038247509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"22'186","reported_seq":220,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:59.001230+0000","last_change":"2024-09-13T18:09:59.001230+0000","last_active":"2024-09-13T18:09:59.001230+0000","last_peered":"2024-09-13T18:09:59.001230+0000","last_clean":"2024-09-13T18:09:59.001230+0000","last_became_active":"2024-09-13T18:06:16.751788+0000","last_became_peered":"2024-09-13T18:06:16.751788+0000","last_unstale":"2024-09-13T18:09:59.001230+0000","last_undegraded":"2024-09-13T18:09:59.001230+0000","last_fullsized":"2024-09-13T18:09:59.001230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'186","last_scrub_stamp":"2024-09-13T18:09:59.000963+0000","last_deep_scrub":"22'186","last_deep_scrub_stamp":"2024-09-13T18:09:59.000963+0000","last_clean_scrub_stamp":"2024-09-13T18:09:59.000963+0000","objects_scrubbed":0,"log_size":186,"log_dups_size":0,"ondisk_log_size":186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:54.118242+0000","scrub_duration":0.0033296850000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":483328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"22'152","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:09.262529+0000","last_change":"2024-09-13T18:10:09.262529+0000","last_active":"2024-09-13T18:10:09.262529+0000","last_peered":"2024-09-13T18:10:09.262529+0000","last_clean":"2024-09-13T18:10:09.262529+0000","last_became_active":"2024-09-13T18:05:26.502617+0000","last_became_peered":"2024-09-13T18:05:26.502617+0000","last_unstale":"2024-09-13T18:10:09.262529+0000","last_undegraded":"2024-09-13T18:10:09.262529+0000","last_fullsized":"2024-09-13T18:10:09.262529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'152","last_scrub_stamp":"2024-09-13T18:10:09.262250+0000","last_deep_scrub":"22'152","last_deep_scrub_stamp":"2024-09-13T18:10:09.262250+0000","last_clean_scrub_stamp":"2024-09-13T18:10:09.262250+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:13.932163+0000","scrub_duration":0.003204415,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"22'156","reported_seq":190,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:55.528306+0000","last_change":"2024-09-13T18:09:55.528306+0000","last_active":"2024-09-13T18:09:55.528306+0000","last_peered":"2024-09-13T18:09:55.528306+0000","last_clean":"2024-09-13T18:09:55.528306+0000","last_became_active":"2024-09-13T18:06:16.720232+0000","last_became_peered":"2024-09-13T18:06:16.720232+0000","last_unstale":"2024-09-13T18:09:55.528306+0000","last_undegraded":"2024-09-13T18:09:55.528306+0000","last_fullsized":"2024-09-13T18:09:55.528306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'156","last_scrub_stamp":"2024-09-13T18:09:55.528042+0000","last_deep_scrub":"22'156","last_deep_scrub_stamp":"2024-09-13T18:09:55.528042+0000","last_clean_scrub_stamp":"2024-09-13T18:09:55.528042+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:53.866210+0000","scrub_duration":0.0033343040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"22'189","reported_seq":215,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.600946+0000","last_change":"2024-09-13T18:09:43.600946+0000","last_active":"2024-09-13T18:09:43.600946+0000","last_peered":"2024-09-13T18:09:43.600946+0000","last_clean":"2024-09-13T18:09:43.600946+0000","last_became_active":"2024-09-13T18:05:26.501396+0000","last_became_peered":"2024-09-13T18:05:26.501396+0000","last_unstale":"2024-09-13T18:09:43.600946+0000","last_undegraded":"2024-09-13T18:09:43.600946+0000","last_fullsized":"2024-09-13T18:09:43.600946+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-09-13T18:09:43.600697+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.600697+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:58.105197+0000","scrub_duration":0.0033266440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"22'142","reported_seq":168,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:50.264137+0000","last_change":"2024-09-13T18:09:50.264137+0000","last_active":"2024-09-13T18:09:50.264137+0000","last_peered":"2024-09-13T18:09:50.264137+0000","last_clean":"2024-09-13T18:09:50.264137+0000","last_became_active":"2024-09-13T18:05:26.497833+0000","last_became_peered":"2024-09-13T18:05:26.497833+0000","last_unstale":"2024-09-13T18:09:50.264137+0000","last_undegraded":"2024-09-13T18:09:50.264137+0000","last_fullsized":"2024-09-13T18:09:50.264137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'142","last_scrub_stamp":"2024-09-13T18:09:50.263785+0000","last_deep_scrub":"22'142","last_deep_scrub_stamp":"2024-09-13T18:09:50.263785+0000","last_clean_scrub_stamp":"2024-09-13T18:09:50.263785+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:49.566618+0000","scrub_duration":0.0030756429999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:00.003964+0000","last_change":"2024-09-13T18:10:00.003964+0000","last_active":"2024-09-13T18:10:00.003964+0000","last_peered":"2024-09-13T18:10:00.003964+0000","last_clean":"2024-09-13T18:10:00.003964+0000","last_became_active":"2024-09-13T18:05:26.499866+0000","last_became_peered":"2024-09-13T18:05:26.499866+0000","last_unstale":"2024-09-13T18:10:00.003964+0000","last_undegraded":"2024-09-13T18:10:00.003964+0000","last_fullsized":"2024-09-13T18:10:00.003964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:10:00.003536+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:10:00.003536+0000","last_clean_scrub_stamp":"2024-09-13T18:10:00.003536+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:10.650450+0000","scrub_duration":0.0039536270000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"22'149","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:58.020529+0000","last_change":"2024-09-13T18:09:58.020529+0000","last_active":"2024-09-13T18:09:58.020529+0000","last_peered":"2024-09-13T18:09:58.020529+0000","last_clean":"2024-09-13T18:09:58.020529+0000","last_became_active":"2024-09-13T18:05:26.486994+0000","last_became_peered":"2024-09-13T18:05:26.486994+0000","last_unstale":"2024-09-13T18:09:58.020529+0000","last_undegraded":"2024-09-13T18:09:58.020529+0000","last_fullsized":"2024-09-13T18:09:58.020529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-09-13T18:09:58.020202+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-09-13T18:09:58.020202+0000","last_clean_scrub_stamp":"2024-09-13T18:09:58.020202+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:25.233099+0000","scrub_duration":0.003147567,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:54.192064+0000","last_change":"2024-09-13T18:09:54.192064+0000","last_active":"2024-09-13T18:09:54.192064+0000","last_peered":"2024-09-13T18:09:54.192064+0000","last_clean":"2024-09-13T18:09:54.192064+0000","last_became_active":"2024-09-13T18:05:26.488312+0000","last_became_peered":"2024-09-13T18:05:26.488312+0000","last_unstale":"2024-09-13T18:09:54.192064+0000","last_undegraded":"2024-09-13T18:09:54.192064+0000","last_fullsized":"2024-09-13T18:09:54.192064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:54.191651+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:54.191651+0000","last_clean_scrub_stamp":"2024-09-13T18:09:54.191651+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:20.477813+0000","scrub_duration":0.0036660590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"22'147","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:55.073558+0000","last_change":"2024-09-13T18:09:55.073558+0000","last_active":"2024-09-13T18:09:55.073558+0000","last_peered":"2024-09-13T18:09:55.073558+0000","last_clean":"2024-09-13T18:09:55.073558+0000","last_became_active":"2024-09-13T18:05:26.489829+0000","last_became_peered":"2024-09-13T18:05:26.489829+0000","last_unstale":"2024-09-13T18:09:55.073558+0000","last_undegraded":"2024-09-13T18:09:55.073558+0000","last_fullsized":"2024-09-13T18:09:55.073558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'147","last_scrub_stamp":"2024-09-13T18:09:55.073264+0000","last_deep_scrub":"22'147","last_deep_scrub_stamp":"2024-09-13T18:09:55.073264+0000","last_clean_scrub_stamp":"2024-09-13T18:09:55.073264+0000","objects_scrubbed":0,"log_size":147,"log_dups_size":0,"ondisk_log_size":147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:40.207855+0000","scrub_duration":0.0037025220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"22'146","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:57.039369+0000","last_change":"2024-09-13T18:09:57.039369+0000","last_active":"2024-09-13T18:09:57.039369+0000","last_peered":"2024-09-13T18:09:57.039369+0000","last_clean":"2024-09-13T18:09:57.039369+0000","last_became_active":"2024-09-13T18:05:26.493438+0000","last_became_peered":"2024-09-13T18:05:26.493438+0000","last_unstale":"2024-09-13T18:09:57.039369+0000","last_undegraded":"2024-09-13T18:09:57.039369+0000","last_fullsized":"2024-09-13T18:09:57.039369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'146","last_scrub_stamp":"2024-09-13T18:09:57.038958+0000","last_deep_scrub":"22'146","last_deep_scrub_stamp":"2024-09-13T18:09:57.038958+0000","last_clean_scrub_stamp":"2024-09-13T18:09:57.038958+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:11:58.200730+0000","scrub_duration":0.0037464040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"22'157","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.585628+0000","last_change":"2024-09-13T18:09:42.585628+0000","last_active":"2024-09-13T18:09:42.585628+0000","last_peered":"2024-09-13T18:09:42.585628+0000","last_clean":"2024-09-13T18:09:42.585628+0000","last_became_active":"2024-09-13T18:05:26.500528+0000","last_became_peered":"2024-09-13T18:05:26.500528+0000","last_unstale":"2024-09-13T18:09:42.585628+0000","last_undegraded":"2024-09-13T18:09:42.585628+0000","last_fullsized":"2024-09-13T18:09:42.585628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:42.585326+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.585326+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.780019+0000","scrub_duration":0.0035655249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"22'172","reported_seq":198,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:10.312338+0000","last_change":"2024-09-13T18:10:10.312639+0000","last_active":"2024-09-13T18:10:10.312338+0000","last_peered":"2024-09-13T18:10:10.312338+0000","last_clean":"2024-09-13T18:10:10.312338+0000","last_became_active":"2024-09-13T18:05:26.483567+0000","last_became_peered":"2024-09-13T18:05:26.483567+0000","last_unstale":"2024-09-13T18:10:10.312338+0000","last_undegraded":"2024-09-13T18:10:10.312338+0000","last_fullsized":"2024-09-13T18:10:10.312338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'172","last_scrub_stamp":"2024-09-13T18:10:10.312215+0000","last_deep_scrub":"22'172","last_deep_scrub_stamp":"2024-09-13T18:10:10.312215+0000","last_clean_scrub_stamp":"2024-09-13T18:10:10.312215+0000","objects_scrubbed":0,"log_size":172,"log_dups_size":0,"ondisk_log_size":172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:10.099387+0000","scrub_duration":0.003871125,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":165,"num_write_kb":450560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"22'161","reported_seq":187,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.563669+0000","last_change":"2024-09-13T18:09:47.563669+0000","last_active":"2024-09-13T18:09:47.563669+0000","last_peered":"2024-09-13T18:09:47.563669+0000","last_clean":"2024-09-13T18:09:47.563669+0000","last_became_active":"2024-09-13T18:05:26.494172+0000","last_became_peered":"2024-09-13T18:05:26.494172+0000","last_unstale":"2024-09-13T18:09:47.563669+0000","last_undegraded":"2024-09-13T18:09:47.563669+0000","last_fullsized":"2024-09-13T18:09:47.563669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'161","last_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_deep_scrub":"22'161","last_deep_scrub_stamp":"2024-09-13T18:09:47.563428+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.563428+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:21.403749+0000","scrub_duration":0.0031339699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":153,"num_write_kb":417792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"22'137","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:54.975949+0000","last_change":"2024-09-13T18:09:54.975949+0000","last_active":"2024-09-13T18:09:54.975949+0000","last_peered":"2024-09-13T18:09:54.975949+0000","last_clean":"2024-09-13T18:09:54.975949+0000","last_became_active":"2024-09-13T18:05:26.488588+0000","last_became_peered":"2024-09-13T18:05:26.488588+0000","last_unstale":"2024-09-13T18:09:54.975949+0000","last_undegraded":"2024-09-13T18:09:54.975949+0000","last_fullsized":"2024-09-13T18:09:54.975949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'137","last_scrub_stamp":"2024-09-13T18:09:54.975660+0000","last_deep_scrub":"22'137","last_deep_scrub_stamp":"2024-09-13T18:09:54.975660+0000","last_clean_scrub_stamp":"2024-09-13T18:09:54.975660+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:47.283697+0000","scrub_duration":0.003384045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"22'166","reported_seq":192,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:02.083642+0000","last_change":"2024-09-13T18:10:02.083944+0000","last_active":"2024-09-13T18:10:02.083642+0000","last_peered":"2024-09-13T18:10:02.083642+0000","last_clean":"2024-09-13T18:10:02.083642+0000","last_became_active":"2024-09-13T18:05:26.500969+0000","last_became_peered":"2024-09-13T18:05:26.500969+0000","last_unstale":"2024-09-13T18:10:02.083642+0000","last_undegraded":"2024-09-13T18:10:02.083642+0000","last_fullsized":"2024-09-13T18:10:02.083642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'166","last_scrub_stamp":"2024-09-13T18:10:02.083533+0000","last_deep_scrub":"22'166","last_deep_scrub_stamp":"2024-09-13T18:10:02.083533+0000","last_clean_scrub_stamp":"2024-09-13T18:10:02.083533+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:27:26.318058+0000","scrub_duration":0.0036909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:56.968222+0000","last_change":"2024-09-13T18:09:56.968222+0000","last_active":"2024-09-13T18:09:56.968222+0000","last_peered":"2024-09-13T18:09:56.968222+0000","last_clean":"2024-09-13T18:09:56.968222+0000","last_became_active":"2024-09-13T18:05:26.485511+0000","last_became_peered":"2024-09-13T18:05:26.485511+0000","last_unstale":"2024-09-13T18:09:56.968222+0000","last_undegraded":"2024-09-13T18:09:56.968222+0000","last_fullsized":"2024-09-13T18:09:56.968222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:56.967906+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:56.967906+0000","last_clean_scrub_stamp":"2024-09-13T18:09:56.967906+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:55.306074+0000","scrub_duration":0.0034048479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"22'180","reported_seq":206,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.133440+0000","last_change":"2024-09-13T18:09:49.133717+0000","last_active":"2024-09-13T18:09:49.133440+0000","last_peered":"2024-09-13T18:09:49.133440+0000","last_clean":"2024-09-13T18:09:49.133440+0000","last_became_active":"2024-09-13T18:05:26.490130+0000","last_became_peered":"2024-09-13T18:05:26.490130+0000","last_unstale":"2024-09-13T18:09:49.133440+0000","last_undegraded":"2024-09-13T18:09:49.133440+0000","last_fullsized":"2024-09-13T18:09:49.133440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'180","last_scrub_stamp":"2024-09-13T18:09:49.133386+0000","last_deep_scrub":"22'180","last_deep_scrub_stamp":"2024-09-13T18:09:49.133386+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.133386+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:59:41.441423+0000","scrub_duration":0.0033144049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":174,"num_write_kb":475136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.843320+0000","last_change":"2024-09-13T18:09:45.843320+0000","last_active":"2024-09-13T18:09:45.843320+0000","last_peered":"2024-09-13T18:09:45.843320+0000","last_clean":"2024-09-13T18:09:45.843320+0000","last_became_active":"2024-09-13T18:05:26.489935+0000","last_became_peered":"2024-09-13T18:05:26.489935+0000","last_unstale":"2024-09-13T18:09:45.843320+0000","last_undegraded":"2024-09-13T18:09:45.843320+0000","last_fullsized":"2024-09-13T18:09:45.843320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:45.843044+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.843044+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:25:01.372679+0000","scrub_duration":0.0036834659999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"22'198","reported_seq":224,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:50.604514+0000","last_change":"2024-09-13T18:09:50.604737+0000","last_active":"2024-09-13T18:09:50.604514+0000","last_peered":"2024-09-13T18:09:50.604514+0000","last_clean":"2024-09-13T18:09:50.604514+0000","last_became_active":"2024-09-13T18:05:26.497031+0000","last_became_peered":"2024-09-13T18:05:26.497031+0000","last_unstale":"2024-09-13T18:09:50.604514+0000","last_undegraded":"2024-09-13T18:09:50.604514+0000","last_fullsized":"2024-09-13T18:09:50.604514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'198","last_scrub_stamp":"2024-09-13T18:09:50.604461+0000","last_deep_scrub":"22'198","last_deep_scrub_stamp":"2024-09-13T18:09:50.604461+0000","last_clean_scrub_stamp":"2024-09-13T18:09:50.604461+0000","objects_scrubbed":0,"log_size":198,"log_dups_size":0,"ondisk_log_size":198,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:46.717159+0000","scrub_duration":0.0032810930000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.177244+0000","last_change":"2024-09-13T18:09:51.177462+0000","last_active":"2024-09-13T18:09:51.177244+0000","last_peered":"2024-09-13T18:09:51.177244+0000","last_clean":"2024-09-13T18:09:51.177244+0000","last_became_active":"2024-09-13T18:05:26.490198+0000","last_became_peered":"2024-09-13T18:05:26.490198+0000","last_unstale":"2024-09-13T18:09:51.177244+0000","last_undegraded":"2024-09-13T18:09:51.177244+0000","last_fullsized":"2024-09-13T18:09:51.177244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:09:51.177192+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:09:51.177192+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.177192+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:44.693439+0000","scrub_duration":0.0033715429999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"22'133","reported_seq":159,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.904114+0000","last_change":"2024-09-13T18:09:43.904114+0000","last_active":"2024-09-13T18:09:43.904114+0000","last_peered":"2024-09-13T18:09:43.904114+0000","last_clean":"2024-09-13T18:09:43.904114+0000","last_became_active":"2024-09-13T18:05:26.488693+0000","last_became_peered":"2024-09-13T18:05:26.488693+0000","last_unstale":"2024-09-13T18:09:43.904114+0000","last_undegraded":"2024-09-13T18:09:43.904114+0000","last_fullsized":"2024-09-13T18:09:43.904114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'133","last_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_deep_scrub":"22'133","last_deep_scrub_stamp":"2024-09-13T18:09:43.903836+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.903836+0000","objects_scrubbed":0,"log_size":133,"log_dups_size":0,"ondisk_log_size":133,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:16.160498+0000","scrub_duration":0.00391735,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"22'118","reported_seq":144,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.031091+0000","last_change":"2024-09-13T18:09:48.031403+0000","last_active":"2024-09-13T18:09:48.031091+0000","last_peered":"2024-09-13T18:09:48.031091+0000","last_clean":"2024-09-13T18:09:48.031091+0000","last_became_active":"2024-09-13T18:05:26.491809+0000","last_became_peered":"2024-09-13T18:05:26.491809+0000","last_unstale":"2024-09-13T18:09:48.031091+0000","last_undegraded":"2024-09-13T18:09:48.031091+0000","last_fullsized":"2024-09-13T18:09:48.031091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'118","last_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_deep_scrub":"22'118","last_deep_scrub_stamp":"2024-09-13T18:09:48.030972+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.030972+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:17.435633+0000","scrub_duration":0.0033291369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":111,"num_write_kb":303104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.106751+0000","last_change":"2024-09-13T18:09:51.106938+0000","last_active":"2024-09-13T18:09:51.106751+0000","last_peered":"2024-09-13T18:09:51.106751+0000","last_clean":"2024-09-13T18:09:51.106751+0000","last_became_active":"2024-09-13T18:05:26.493496+0000","last_became_peered":"2024-09-13T18:05:26.493496+0000","last_unstale":"2024-09-13T18:09:51.106751+0000","last_undegraded":"2024-09-13T18:09:51.106751+0000","last_fullsized":"2024-09-13T18:09:51.106751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:51.106699+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:51.106699+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.106699+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:19.935330+0000","scrub_duration":0.0036154820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.534744+0000","last_change":"2024-09-13T18:09:44.535039+0000","last_active":"2024-09-13T18:09:44.534744+0000","last_peered":"2024-09-13T18:09:44.534744+0000","last_clean":"2024-09-13T18:09:44.534744+0000","last_became_active":"2024-09-13T18:05:26.485769+0000","last_became_peered":"2024-09-13T18:05:26.485769+0000","last_unstale":"2024-09-13T18:09:44.534744+0000","last_undegraded":"2024-09-13T18:09:44.534744+0000","last_fullsized":"2024-09-13T18:09:44.534744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:09:44.534635+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.534635+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:12.372830+0000","scrub_duration":0.0037670020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"22'150","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.561338+0000","last_change":"2024-09-13T18:09:51.561576+0000","last_active":"2024-09-13T18:09:51.561338+0000","last_peered":"2024-09-13T18:09:51.561338+0000","last_clean":"2024-09-13T18:09:51.561338+0000","last_became_active":"2024-09-13T18:05:26.494918+0000","last_became_peered":"2024-09-13T18:05:26.494918+0000","last_unstale":"2024-09-13T18:09:51.561338+0000","last_undegraded":"2024-09-13T18:09:51.561338+0000","last_fullsized":"2024-09-13T18:09:51.561338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-09-13T18:09:51.561284+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-09-13T18:09:51.561284+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.561284+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:49.829448+0000","scrub_duration":0.0034084549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"22'130","reported_seq":156,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.216871+0000","last_change":"2024-09-13T18:09:44.216871+0000","last_active":"2024-09-13T18:09:44.216871+0000","last_peered":"2024-09-13T18:09:44.216871+0000","last_clean":"2024-09-13T18:09:44.216871+0000","last_became_active":"2024-09-13T18:05:26.485875+0000","last_became_peered":"2024-09-13T18:05:26.485875+0000","last_unstale":"2024-09-13T18:09:44.216871+0000","last_undegraded":"2024-09-13T18:09:44.216871+0000","last_fullsized":"2024-09-13T18:09:44.216871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'130","last_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_deep_scrub":"22'130","last_deep_scrub_stamp":"2024-09-13T18:09:44.216550+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.216550+0000","objects_scrubbed":0,"log_size":130,"log_dups_size":0,"ondisk_log_size":130,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:41.980606+0000","scrub_duration":0.003700942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'8","reported_seq":35,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.935774+0000","last_change":"2024-09-13T18:09:30.935774+0000","last_active":"2024-09-13T18:09:30.935774+0000","last_peered":"2024-09-13T18:09:30.935774+0000","last_clean":"2024-09-13T18:09:30.935774+0000","last_became_active":"2024-09-13T18:05:26.124071+0000","last_became_peered":"2024-09-13T18:05:26.124071+0000","last_unstale":"2024-09-13T18:09:30.935774+0000","last_undegraded":"2024-09-13T18:09:30.935774+0000","last_fullsized":"2024-09-13T18:09:30.935774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'8","last_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_deep_scrub":"22'8","last_deep_scrub_stamp":"2024-09-13T18:09:30.935626+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.935626+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:28.699682+0000","scrub_duration":0.0055564289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1157,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"22'137","reported_seq":163,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.170943+0000","last_change":"2024-09-13T18:09:42.170943+0000","last_active":"2024-09-13T18:09:42.170943+0000","last_peered":"2024-09-13T18:09:42.170943+0000","last_clean":"2024-09-13T18:09:42.170943+0000","last_became_active":"2024-09-13T18:05:26.479335+0000","last_became_peered":"2024-09-13T18:05:26.479335+0000","last_unstale":"2024-09-13T18:09:42.170943+0000","last_undegraded":"2024-09-13T18:09:42.170943+0000","last_fullsized":"2024-09-13T18:09:42.170943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'137","last_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_deep_scrub":"22'137","last_deep_scrub_stamp":"2024-09-13T18:09:42.170737+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.170737+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:26.463444+0000","scrub_duration":0.0029453280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.778450+0000","last_change":"2024-09-13T18:09:32.778450+0000","last_active":"2024-09-13T18:09:32.778450+0000","last_peered":"2024-09-13T18:09:32.778450+0000","last_clean":"2024-09-13T18:09:32.778450+0000","last_became_active":"2024-09-13T18:05:26.106877+0000","last_became_peered":"2024-09-13T18:05:26.106877+0000","last_unstale":"2024-09-13T18:09:32.778450+0000","last_undegraded":"2024-09-13T18:09:32.778450+0000","last_fullsized":"2024-09-13T18:09:32.778450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.778184+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.778184+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:36.981991+0000","scrub_duration":0.0058238919999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.902293+0000","last_change":"2024-09-13T18:09:36.902293+0000","last_active":"2024-09-13T18:09:36.902293+0000","last_peered":"2024-09-13T18:09:36.902293+0000","last_clean":"2024-09-13T18:09:36.902293+0000","last_became_active":"2024-09-13T18:05:26.117944+0000","last_became_peered":"2024-09-13T18:05:26.117944+0000","last_unstale":"2024-09-13T18:09:36.902293+0000","last_undegraded":"2024-09-13T18:09:36.902293+0000","last_fullsized":"2024-09-13T18:09:36.902293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.902006+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.902006+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.204839+0000","scrub_duration":0.006253906,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"22'170","reported_seq":196,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:52.881541+0000","last_change":"2024-09-13T18:09:52.881541+0000","last_active":"2024-09-13T18:09:52.881541+0000","last_peered":"2024-09-13T18:09:52.881541+0000","last_clean":"2024-09-13T18:09:52.881541+0000","last_became_active":"2024-09-13T18:05:26.490202+0000","last_became_peered":"2024-09-13T18:05:26.490202+0000","last_unstale":"2024-09-13T18:09:52.881541+0000","last_undegraded":"2024-09-13T18:09:52.881541+0000","last_fullsized":"2024-09-13T18:09:52.881541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'170","last_scrub_stamp":"2024-09-13T18:09:52.881268+0000","last_deep_scrub":"22'170","last_deep_scrub_stamp":"2024-09-13T18:09:52.881268+0000","last_clean_scrub_stamp":"2024-09-13T18:09:52.881268+0000","objects_scrubbed":0,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:51.149431+0000","scrub_duration":0.0030826159999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":162,"num_write_kb":442368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"20'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.208876+0000","last_change":"2024-09-13T18:09:37.208876+0000","last_active":"2024-09-13T18:09:37.208876+0000","last_peered":"2024-09-13T18:09:37.208876+0000","last_clean":"2024-09-13T18:09:37.208876+0000","last_became_active":"2024-09-13T18:05:26.107522+0000","last_became_peered":"2024-09-13T18:05:26.107522+0000","last_unstale":"2024-09-13T18:09:37.208876+0000","last_undegraded":"2024-09-13T18:09:37.208876+0000","last_fullsized":"2024-09-13T18:09:37.208876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:37.208558+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.208558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:40.391942+0000","scrub_duration":0.0030340900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"22'157","reported_seq":183,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.133895+0000","last_change":"2024-09-13T18:09:49.133895+0000","last_active":"2024-09-13T18:09:49.133895+0000","last_peered":"2024-09-13T18:09:49.133895+0000","last_clean":"2024-09-13T18:09:49.133895+0000","last_became_active":"2024-09-13T18:05:26.490159+0000","last_became_peered":"2024-09-13T18:05:26.490159+0000","last_unstale":"2024-09-13T18:09:49.133895+0000","last_undegraded":"2024-09-13T18:09:49.133895+0000","last_fullsized":"2024-09-13T18:09:49.133895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:49.133501+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.133501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:03.638000+0000","scrub_duration":0.0029741580000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.686942+0000","last_change":"2024-09-13T18:09:38.686942+0000","last_active":"2024-09-13T18:09:38.686942+0000","last_peered":"2024-09-13T18:09:38.686942+0000","last_clean":"2024-09-13T18:09:38.686942+0000","last_became_active":"2024-09-13T18:05:26.108920+0000","last_became_peered":"2024-09-13T18:05:26.108920+0000","last_unstale":"2024-09-13T18:09:38.686942+0000","last_undegraded":"2024-09-13T18:09:38.686942+0000","last_fullsized":"2024-09-13T18:09:38.686942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:38.686658+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.686658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.524853+0000","scrub_duration":0.006664489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"22'229","reported_seq":255,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.179600+0000","last_change":"2024-09-13T18:09:33.179600+0000","last_active":"2024-09-13T18:09:33.179600+0000","last_peered":"2024-09-13T18:09:33.179600+0000","last_clean":"2024-09-13T18:09:33.179600+0000","last_became_active":"2024-09-13T18:05:26.493364+0000","last_became_peered":"2024-09-13T18:05:26.493364+0000","last_unstale":"2024-09-13T18:09:33.179600+0000","last_undegraded":"2024-09-13T18:09:33.179600+0000","last_fullsized":"2024-09-13T18:09:33.179600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'229","last_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_deep_scrub":"22'229","last_deep_scrub_stamp":"2024-09-13T18:09:33.179314+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.179314+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:56.729956+0000","scrub_duration":0.0032080260000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":598016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.189324+0000","last_change":"2024-09-13T18:09:36.189324+0000","last_active":"2024-09-13T18:09:36.189324+0000","last_peered":"2024-09-13T18:09:36.189324+0000","last_clean":"2024-09-13T18:09:36.189324+0000","last_became_active":"2024-09-13T18:05:26.112406+0000","last_became_peered":"2024-09-13T18:05:26.112406+0000","last_unstale":"2024-09-13T18:09:36.189324+0000","last_undegraded":"2024-09-13T18:09:36.189324+0000","last_fullsized":"2024-09-13T18:09:36.189324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:36.189056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.189056+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:20.481764+0000","scrub_duration":0.0058978600000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"22'141","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.145140+0000","last_change":"2024-09-13T18:09:43.145140+0000","last_active":"2024-09-13T18:09:43.145140+0000","last_peered":"2024-09-13T18:09:43.145140+0000","last_clean":"2024-09-13T18:09:43.145140+0000","last_became_active":"2024-09-13T18:05:26.503635+0000","last_became_peered":"2024-09-13T18:05:26.503635+0000","last_unstale":"2024-09-13T18:09:43.145140+0000","last_undegraded":"2024-09-13T18:09:43.145140+0000","last_fullsized":"2024-09-13T18:09:43.145140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'141","last_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_deep_scrub":"22'141","last_deep_scrub_stamp":"2024-09-13T18:09:43.144592+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.144592+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:46.327975+0000","scrub_duration":0.003201546,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'12","reported_seq":39,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.124854+0000","last_change":"2024-09-13T18:09:42.124854+0000","last_active":"2024-09-13T18:09:42.124854+0000","last_peered":"2024-09-13T18:09:42.124854+0000","last_clean":"2024-09-13T18:09:42.124854+0000","last_became_active":"2024-09-13T18:05:26.112143+0000","last_became_peered":"2024-09-13T18:05:26.112143+0000","last_unstale":"2024-09-13T18:09:42.124854+0000","last_undegraded":"2024-09-13T18:09:42.124854+0000","last_fullsized":"2024-09-13T18:09:42.124854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:42.124622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.124622+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:16.319315+0000","scrub_duration":0.0081039130000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"22'149","reported_seq":175,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.153755+0000","last_change":"2024-09-13T18:09:41.153755+0000","last_active":"2024-09-13T18:09:41.153755+0000","last_peered":"2024-09-13T18:09:41.153755+0000","last_clean":"2024-09-13T18:09:41.153755+0000","last_became_active":"2024-09-13T18:05:26.485430+0000","last_became_peered":"2024-09-13T18:05:26.485430+0000","last_unstale":"2024-09-13T18:09:41.153755+0000","last_undegraded":"2024-09-13T18:09:41.153755+0000","last_fullsized":"2024-09-13T18:09:41.153755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'149","last_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_deep_scrub":"22'149","last_deep_scrub_stamp":"2024-09-13T18:09:41.153466+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.153466+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:03.341358+0000","scrub_duration":0.0036038070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'98","reported_seq":125,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.723073+0000","last_change":"2024-09-13T18:09:36.723073+0000","last_active":"2024-09-13T18:09:36.723073+0000","last_peered":"2024-09-13T18:09:36.723073+0000","last_clean":"2024-09-13T18:09:36.723073+0000","last_became_active":"2024-09-13T18:05:26.117803+0000","last_became_peered":"2024-09-13T18:05:26.117803+0000","last_unstale":"2024-09-13T18:09:36.723073+0000","last_undegraded":"2024-09-13T18:09:36.723073+0000","last_fullsized":"2024-09-13T18:09:36.723073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'98","last_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_deep_scrub":"22'98","last_deep_scrub_stamp":"2024-09-13T18:09:36.722843+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.722843+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:10.917536+0000","scrub_duration":0.0097799819999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217508,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":95,"num_write_kb":252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"22'150","reported_seq":176,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:06.217291+0000","last_change":"2024-09-13T18:10:06.217291+0000","last_active":"2024-09-13T18:10:06.217291+0000","last_peered":"2024-09-13T18:10:06.217291+0000","last_clean":"2024-09-13T18:10:06.217291+0000","last_became_active":"2024-09-13T18:05:26.488272+0000","last_became_peered":"2024-09-13T18:05:26.488272+0000","last_unstale":"2024-09-13T18:10:06.217291+0000","last_undegraded":"2024-09-13T18:10:06.217291+0000","last_fullsized":"2024-09-13T18:10:06.217291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'150","last_scrub_stamp":"2024-09-13T18:10:06.217035+0000","last_deep_scrub":"22'150","last_deep_scrub_stamp":"2024-09-13T18:10:06.217035+0000","last_clean_scrub_stamp":"2024-09-13T18:10:06.217035+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:28.440213+0000","scrub_duration":0.0037585539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'10","reported_seq":37,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.076084+0000","last_change":"2024-09-13T18:09:30.076084+0000","last_active":"2024-09-13T18:09:30.076084+0000","last_peered":"2024-09-13T18:09:30.076084+0000","last_clean":"2024-09-13T18:09:30.076084+0000","last_became_active":"2024-09-13T18:05:26.113906+0000","last_became_peered":"2024-09-13T18:05:26.113906+0000","last_unstale":"2024-09-13T18:09:30.076084+0000","last_undegraded":"2024-09-13T18:09:30.076084+0000","last_fullsized":"2024-09-13T18:09:30.076084+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'10","last_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_deep_scrub":"22'10","last_deep_scrub_stamp":"2024-09-13T18:09:30.075970+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.075970+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:04:22.024885+0000","scrub_duration":0.0071596519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"22'157","reported_seq":180,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.490414+0000","last_change":"2024-09-13T18:09:47.490666+0000","last_active":"2024-09-13T18:09:47.490414+0000","last_peered":"2024-09-13T18:09:47.490414+0000","last_clean":"2024-09-13T18:09:47.490414+0000","last_became_active":"2024-09-13T18:06:17.149423+0000","last_became_peered":"2024-09-13T18:06:17.149423+0000","last_unstale":"2024-09-13T18:09:47.490414+0000","last_undegraded":"2024-09-13T18:09:47.490414+0000","last_fullsized":"2024-09-13T18:09:47.490414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'157","last_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_deep_scrub":"22'157","last_deep_scrub_stamp":"2024-09-13T18:09:47.490364+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.490364+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.759873+0000","scrub_duration":0.003581351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.12","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.125686+0000","last_change":"2024-09-13T18:09:48.125686+0000","last_active":"2024-09-13T18:09:48.125686+0000","last_peered":"2024-09-13T18:09:48.125686+0000","last_clean":"2024-09-13T18:09:48.125686+0000","last_became_active":"2024-09-13T18:05:26.118230+0000","last_became_peered":"2024-09-13T18:05:26.118230+0000","last_unstale":"2024-09-13T18:09:48.125686+0000","last_undegraded":"2024-09-13T18:09:48.125686+0000","last_fullsized":"2024-09-13T18:09:48.125686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:48.125424+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:48.125424+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.125424+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:16.882839+0000","scrub_duration":0.0056341389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'171","reported_seq":197,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:58.329511+0000","last_change":"2024-09-13T18:09:58.329511+0000","last_active":"2024-09-13T18:09:58.329511+0000","last_peered":"2024-09-13T18:09:58.329511+0000","last_clean":"2024-09-13T18:09:58.329511+0000","last_became_active":"2024-09-13T18:05:26.488782+0000","last_became_peered":"2024-09-13T18:05:26.488782+0000","last_unstale":"2024-09-13T18:09:58.329511+0000","last_undegraded":"2024-09-13T18:09:58.329511+0000","last_fullsized":"2024-09-13T18:09:58.329511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'171","last_scrub_stamp":"2024-09-13T18:09:58.329031+0000","last_deep_scrub":"22'171","last_deep_scrub_stamp":"2024-09-13T18:09:58.329031+0000","last_clean_scrub_stamp":"2024-09-13T18:09:58.329031+0000","objects_scrubbed":0,"log_size":171,"log_dups_size":0,"ondisk_log_size":171,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:56.189225+0000","scrub_duration":0.00333746,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.573145+0000","last_change":"2024-09-13T18:09:41.573145+0000","last_active":"2024-09-13T18:09:41.573145+0000","last_peered":"2024-09-13T18:09:41.573145+0000","last_clean":"2024-09-13T18:09:41.573145+0000","last_became_active":"2024-09-13T18:05:26.106138+0000","last_became_peered":"2024-09-13T18:05:26.106138+0000","last_unstale":"2024-09-13T18:09:41.573145+0000","last_undegraded":"2024-09-13T18:09:41.573145+0000","last_fullsized":"2024-09-13T18:09:41.573145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:41.572829+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.572829+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:03.842338+0000","scrub_duration":0.0068975479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"22'165","reported_seq":191,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.577331+0000","last_change":"2024-09-13T18:09:45.577331+0000","last_active":"2024-09-13T18:09:45.577331+0000","last_peered":"2024-09-13T18:09:45.577331+0000","last_clean":"2024-09-13T18:09:45.577331+0000","last_became_active":"2024-09-13T18:05:26.494611+0000","last_became_peered":"2024-09-13T18:05:26.494611+0000","last_unstale":"2024-09-13T18:09:45.577331+0000","last_undegraded":"2024-09-13T18:09:45.577331+0000","last_fullsized":"2024-09-13T18:09:45.577331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'165","last_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_deep_scrub":"22'165","last_deep_scrub_stamp":"2024-09-13T18:09:45.577074+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.577074+0000","objects_scrubbed":0,"log_size":165,"log_dups_size":0,"ondisk_log_size":165,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:39.093321+0000","scrub_duration":0.0035030899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":159,"num_write_kb":434176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'24","reported_seq":51,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.680306+0000","last_change":"2024-09-13T18:09:32.680306+0000","last_active":"2024-09-13T18:09:32.680306+0000","last_peered":"2024-09-13T18:09:32.680306+0000","last_clean":"2024-09-13T18:09:32.680306+0000","last_became_active":"2024-09-13T18:05:26.111611+0000","last_became_peered":"2024-09-13T18:05:26.111611+0000","last_unstale":"2024-09-13T18:09:32.680306+0000","last_undegraded":"2024-09-13T18:09:32.680306+0000","last_fullsized":"2024-09-13T18:09:32.680306+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'24","last_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_deep_scrub":"22'24","last_deep_scrub_stamp":"2024-09-13T18:09:32.680105+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.680105+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:14.568207+0000","scrub_duration":0.013891555999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"22'189","reported_seq":215,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:56.298656+0000","last_change":"2024-09-13T18:09:56.298656+0000","last_active":"2024-09-13T18:09:56.298656+0000","last_peered":"2024-09-13T18:09:56.298656+0000","last_clean":"2024-09-13T18:09:56.298656+0000","last_became_active":"2024-09-13T18:05:26.480238+0000","last_became_peered":"2024-09-13T18:05:26.480238+0000","last_unstale":"2024-09-13T18:09:56.298656+0000","last_undegraded":"2024-09-13T18:09:56.298656+0000","last_fullsized":"2024-09-13T18:09:56.298656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'189","last_scrub_stamp":"2024-09-13T18:09:56.298218+0000","last_deep_scrub":"22'189","last_deep_scrub_stamp":"2024-09-13T18:09:56.298218+0000","last_clean_scrub_stamp":"2024-09-13T18:09:56.298218+0000","objects_scrubbed":0,"log_size":189,"log_dups_size":0,"ondisk_log_size":189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:51.415496+0000","scrub_duration":0.0039194690000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":183,"num_write_kb":499712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.294830+0000","last_change":"2024-09-13T18:09:32.294830+0000","last_active":"2024-09-13T18:09:32.294830+0000","last_peered":"2024-09-13T18:09:32.294830+0000","last_clean":"2024-09-13T18:09:32.294830+0000","last_became_active":"2024-09-13T18:05:26.108289+0000","last_became_peered":"2024-09-13T18:05:26.108289+0000","last_unstale":"2024-09-13T18:09:32.294830+0000","last_undegraded":"2024-09-13T18:09:32.294830+0000","last_fullsized":"2024-09-13T18:09:32.294830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:32.294535+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.294535+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:57.770286+0000","scrub_duration":0.0068459749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"22'146","reported_seq":172,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:57.285513+0000","last_change":"2024-09-13T18:09:57.285513+0000","last_active":"2024-09-13T18:09:57.285513+0000","last_peered":"2024-09-13T18:09:57.285513+0000","last_clean":"2024-09-13T18:09:57.285513+0000","last_became_active":"2024-09-13T18:05:26.480236+0000","last_became_peered":"2024-09-13T18:05:26.480236+0000","last_unstale":"2024-09-13T18:09:57.285513+0000","last_undegraded":"2024-09-13T18:09:57.285513+0000","last_fullsized":"2024-09-13T18:09:57.285513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'146","last_scrub_stamp":"2024-09-13T18:09:57.285356+0000","last_deep_scrub":"22'146","last_deep_scrub_stamp":"2024-09-13T18:09:57.285356+0000","last_clean_scrub_stamp":"2024-09-13T18:09:57.285356+0000","objects_scrubbed":0,"log_size":146,"log_dups_size":0,"ondisk_log_size":146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:05:07.932270+0000","scrub_duration":0.0029293700000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":141,"num_write_kb":385024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.598029+0000","last_change":"2024-09-13T18:09:38.598029+0000","last_active":"2024-09-13T18:09:38.598029+0000","last_peered":"2024-09-13T18:09:38.598029+0000","last_clean":"2024-09-13T18:09:38.598029+0000","last_became_active":"2024-09-13T18:05:26.112933+0000","last_became_peered":"2024-09-13T18:05:26.112933+0000","last_unstale":"2024-09-13T18:09:38.598029+0000","last_undegraded":"2024-09-13T18:09:38.598029+0000","last_fullsized":"2024-09-13T18:09:38.598029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:38.597681+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.597681+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:42.801488+0000","scrub_duration":0.0054668370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"22'138","reported_seq":164,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.547319+0000","last_change":"2024-09-13T18:09:33.547319+0000","last_active":"2024-09-13T18:09:33.547319+0000","last_peered":"2024-09-13T18:09:33.547319+0000","last_clean":"2024-09-13T18:09:33.547319+0000","last_became_active":"2024-09-13T18:05:26.481068+0000","last_became_peered":"2024-09-13T18:05:26.481068+0000","last_unstale":"2024-09-13T18:09:33.547319+0000","last_undegraded":"2024-09-13T18:09:33.547319+0000","last_fullsized":"2024-09-13T18:09:33.547319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'138","last_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_deep_scrub":"22'138","last_deep_scrub_stamp":"2024-09-13T18:09:33.546894+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.546894+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:32.849726+0000","scrub_duration":0.0035765160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:38.150471+0000","last_change":"2024-09-13T18:09:38.150471+0000","last_active":"2024-09-13T18:09:38.150471+0000","last_peered":"2024-09-13T18:09:38.150471+0000","last_clean":"2024-09-13T18:09:38.150471+0000","last_became_active":"2024-09-13T18:05:26.109226+0000","last_became_peered":"2024-09-13T18:05:26.109226+0000","last_unstale":"2024-09-13T18:09:38.150471+0000","last_undegraded":"2024-09-13T18:09:38.150471+0000","last_fullsized":"2024-09-13T18:09:38.150471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:38.150113+0000","last_clean_scrub_stamp":"2024-09-13T18:09:38.150113+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:35.914168+0000","scrub_duration":0.006034981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:09.994850+0000","last_change":"2024-09-13T18:10:09.995209+0000","last_active":"2024-09-13T18:10:09.994850+0000","last_peered":"2024-09-13T18:10:09.994850+0000","last_clean":"2024-09-13T18:10:09.994850+0000","last_became_active":"2024-09-13T18:05:26.490001+0000","last_became_peered":"2024-09-13T18:05:26.490001+0000","last_unstale":"2024-09-13T18:10:09.994850+0000","last_undegraded":"2024-09-13T18:10:09.994850+0000","last_fullsized":"2024-09-13T18:10:09.994850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:10:09.994801+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:10:09.994801+0000","last_clean_scrub_stamp":"2024-09-13T18:10:09.994801+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:12.703927+0000","scrub_duration":0.0034366359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.623881+0000","last_change":"2024-09-13T18:09:34.623881+0000","last_active":"2024-09-13T18:09:34.623881+0000","last_peered":"2024-09-13T18:09:34.623881+0000","last_clean":"2024-09-13T18:09:34.623881+0000","last_became_active":"2024-09-13T18:05:26.119792+0000","last_became_peered":"2024-09-13T18:05:26.119792+0000","last_unstale":"2024-09-13T18:09:34.623881+0000","last_undegraded":"2024-09-13T18:09:34.623881+0000","last_fullsized":"2024-09-13T18:09:34.623881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:34.623632+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.623632+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.811523+0000","scrub_duration":0.0076832480000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'151","reported_seq":177,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.504722+0000","last_change":"2024-09-13T18:09:36.504722+0000","last_active":"2024-09-13T18:09:36.504722+0000","last_peered":"2024-09-13T18:09:36.504722+0000","last_clean":"2024-09-13T18:09:36.504722+0000","last_became_active":"2024-09-13T18:05:26.501796+0000","last_became_peered":"2024-09-13T18:05:26.501796+0000","last_unstale":"2024-09-13T18:09:36.504722+0000","last_undegraded":"2024-09-13T18:09:36.504722+0000","last_fullsized":"2024-09-13T18:09:36.504722+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'151","last_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_deep_scrub":"22'151","last_deep_scrub_stamp":"2024-09-13T18:09:36.504299+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.504299+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:38.659785+0000","scrub_duration":0.0035044780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'119","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.537687+0000","last_change":"2024-09-13T18:09:39.537874+0000","last_active":"2024-09-13T18:09:39.537687+0000","last_peered":"2024-09-13T18:09:39.537687+0000","last_clean":"2024-09-13T18:09:39.537687+0000","last_became_active":"2024-09-13T18:05:20.875041+0000","last_became_peered":"2024-09-13T18:05:20.875041+0000","last_unstale":"2024-09-13T18:09:39.537687+0000","last_undegraded":"2024-09-13T18:09:39.537687+0000","last_fullsized":"2024-09-13T18:09:39.537687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'119","last_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_deep_scrub":"22'119","last_deep_scrub_stamp":"2024-09-13T18:09:39.537607+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.537607+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:01.807117+0000","scrub_duration":0.0094788149999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"22'6","reported_seq":33,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:35.176804+0000","last_change":"2024-09-13T18:09:35.176804+0000","last_active":"2024-09-13T18:09:35.176804+0000","last_peered":"2024-09-13T18:09:35.176804+0000","last_clean":"2024-09-13T18:09:35.176804+0000","last_became_active":"2024-09-13T18:05:26.107845+0000","last_became_peered":"2024-09-13T18:05:26.107845+0000","last_unstale":"2024-09-13T18:09:35.176804+0000","last_undegraded":"2024-09-13T18:09:35.176804+0000","last_fullsized":"2024-09-13T18:09:35.176804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'6","last_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_deep_scrub":"22'6","last_deep_scrub_stamp":"2024-09-13T18:09:35.176624+0000","last_clean_scrub_stamp":"2024-09-13T18:09:35.176624+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:40.891116+0000","scrub_duration":0.0065320040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"22'158","reported_seq":182,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:49.504486+0000","last_change":"2024-09-13T18:09:49.504486+0000","last_active":"2024-09-13T18:09:49.504486+0000","last_peered":"2024-09-13T18:09:49.504486+0000","last_clean":"2024-09-13T18:09:49.504486+0000","last_became_active":"2024-09-13T18:06:17.226865+0000","last_became_peered":"2024-09-13T18:06:17.226865+0000","last_unstale":"2024-09-13T18:09:49.504486+0000","last_undegraded":"2024-09-13T18:09:49.504486+0000","last_fullsized":"2024-09-13T18:09:49.504486+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'158","last_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_deep_scrub":"22'158","last_deep_scrub_stamp":"2024-09-13T18:09:49.504233+0000","last_clean_scrub_stamp":"2024-09-13T18:09:49.504233+0000","objects_scrubbed":0,"log_size":158,"log_dups_size":0,"ondisk_log_size":158,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:04.008733+0000","scrub_duration":0.0035247329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":150,"num_write_kb":409600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"22'4","reported_seq":31,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:41.470534+0000","last_change":"2024-09-13T18:09:41.470738+0000","last_active":"2024-09-13T18:09:41.470534+0000","last_peered":"2024-09-13T18:09:41.470534+0000","last_clean":"2024-09-13T18:09:41.470534+0000","last_became_active":"2024-09-13T18:05:26.116350+0000","last_became_peered":"2024-09-13T18:05:26.116350+0000","last_unstale":"2024-09-13T18:09:41.470534+0000","last_undegraded":"2024-09-13T18:09:41.470534+0000","last_fullsized":"2024-09-13T18:09:41.470534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'4","last_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_deep_scrub":"22'4","last_deep_scrub_stamp":"2024-09-13T18:09:41.470474+0000","last_clean_scrub_stamp":"2024-09-13T18:09:41.470474+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:55.974974+0000","scrub_duration":0.0059467979999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:32.072172+0000","last_change":"2024-09-13T18:09:32.072172+0000","last_active":"2024-09-13T18:09:32.072172+0000","last_peered":"2024-09-13T18:09:32.072172+0000","last_clean":"2024-09-13T18:09:32.072172+0000","last_became_active":"2024-09-13T18:05:26.483537+0000","last_became_peered":"2024-09-13T18:05:26.483537+0000","last_unstale":"2024-09-13T18:09:32.072172+0000","last_undegraded":"2024-09-13T18:09:32.072172+0000","last_fullsized":"2024-09-13T18:09:32.072172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:32.071942+0000","last_clean_scrub_stamp":"2024-09-13T18:09:32.071942+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:41:41.490052+0000","scrub_duration":0.0031235960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":126,"num_write_kb":344064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"22'12","reported_seq":44,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.594539+0000","last_change":"2024-09-13T18:09:40.594759+0000","last_active":"2024-09-13T18:09:40.594539+0000","last_peered":"2024-09-13T18:09:40.594539+0000","last_clean":"2024-09-13T18:09:40.594539+0000","last_became_active":"2024-09-13T18:05:26.118840+0000","last_became_peered":"2024-09-13T18:05:26.118840+0000","last_unstale":"2024-09-13T18:09:40.594539+0000","last_undegraded":"2024-09-13T18:09:40.594539+0000","last_fullsized":"2024-09-13T18:09:40.594539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'12","last_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_deep_scrub":"22'12","last_deep_scrub_stamp":"2024-09-13T18:09:40.594477+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.594477+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:33.040319+0000","scrub_duration":0.007660605,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":595,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"22'131","reported_seq":157,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.079385+0000","last_change":"2024-09-13T18:09:44.079588+0000","last_active":"2024-09-13T18:09:44.079385+0000","last_peered":"2024-09-13T18:09:44.079385+0000","last_clean":"2024-09-13T18:09:44.079385+0000","last_became_active":"2024-09-13T18:05:26.488412+0000","last_became_peered":"2024-09-13T18:05:26.488412+0000","last_unstale":"2024-09-13T18:09:44.079385+0000","last_undegraded":"2024-09-13T18:09:44.079385+0000","last_fullsized":"2024-09-13T18:09:44.079385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'131","last_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_deep_scrub":"22'131","last_deep_scrub_stamp":"2024-09-13T18:09:44.079336+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.079336+0000","objects_scrubbed":0,"log_size":131,"log_dups_size":0,"ondisk_log_size":131,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:11.917531+0000","scrub_duration":0.0030879660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'1","reported_seq":28,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.120445+0000","last_change":"2024-09-13T18:09:42.120682+0000","last_active":"2024-09-13T18:09:42.120445+0000","last_peered":"2024-09-13T18:09:42.120445+0000","last_clean":"2024-09-13T18:09:42.120445+0000","last_became_active":"2024-09-13T18:05:26.116127+0000","last_became_peered":"2024-09-13T18:05:26.116127+0000","last_unstale":"2024-09-13T18:09:42.120445+0000","last_undegraded":"2024-09-13T18:09:42.120445+0000","last_fullsized":"2024-09-13T18:09:42.120445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-09-13T18:09:42.120388+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.120388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:11.525048+0000","scrub_duration":0.0039379339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"22'145","reported_seq":171,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:36.206072+0000","last_change":"2024-09-13T18:09:36.206072+0000","last_active":"2024-09-13T18:09:36.206072+0000","last_peered":"2024-09-13T18:09:36.206072+0000","last_clean":"2024-09-13T18:09:36.206072+0000","last_became_active":"2024-09-13T18:05:26.481150+0000","last_became_peered":"2024-09-13T18:05:26.481150+0000","last_unstale":"2024-09-13T18:09:36.206072+0000","last_undegraded":"2024-09-13T18:09:36.206072+0000","last_fullsized":"2024-09-13T18:09:36.206072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'145","last_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_deep_scrub":"22'145","last_deep_scrub_stamp":"2024-09-13T18:09:36.205813+0000","last_clean_scrub_stamp":"2024-09-13T18:09:36.205813+0000","objects_scrubbed":0,"log_size":145,"log_dups_size":0,"ondisk_log_size":145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:06:46.067844+0000","scrub_duration":0.0034410579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.185425+0000","last_change":"2024-09-13T18:09:34.185425+0000","last_active":"2024-09-13T18:09:34.185425+0000","last_peered":"2024-09-13T18:09:34.185425+0000","last_clean":"2024-09-13T18:09:34.185425+0000","last_became_active":"2024-09-13T18:05:26.112030+0000","last_became_peered":"2024-09-13T18:05:26.112030+0000","last_unstale":"2024-09-13T18:09:34.185425+0000","last_undegraded":"2024-09-13T18:09:34.185425+0000","last_fullsized":"2024-09-13T18:09:34.185425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:09:34.185154+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.185154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:56.373045+0000","scrub_duration":0.0028065149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:52.149646+0000","last_change":"2024-09-13T18:09:52.149955+0000","last_active":"2024-09-13T18:09:52.149646+0000","last_peered":"2024-09-13T18:09:52.149646+0000","last_clean":"2024-09-13T18:09:52.149646+0000","last_became_active":"2024-09-13T18:05:26.501258+0000","last_became_peered":"2024-09-13T18:05:26.501258+0000","last_unstale":"2024-09-13T18:09:52.149646+0000","last_undegraded":"2024-09-13T18:09:52.149646+0000","last_fullsized":"2024-09-13T18:09:52.149646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:52.149518+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:52.149518+0000","last_clean_scrub_stamp":"2024-09-13T18:09:52.149518+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:42.549523+0000","scrub_duration":0.0035626189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:46.350372+0000","last_change":"2024-09-13T18:09:46.350687+0000","last_active":"2024-09-13T18:09:46.350372+0000","last_peered":"2024-09-13T18:09:46.350372+0000","last_clean":"2024-09-13T18:09:46.350372+0000","last_became_active":"2024-09-13T18:05:26.119265+0000","last_became_peered":"2024-09-13T18:05:26.119265+0000","last_unstale":"2024-09-13T18:09:46.350372+0000","last_undegraded":"2024-09-13T18:09:46.350372+0000","last_fullsized":"2024-09-13T18:09:46.350372+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:46.350302+0000","last_clean_scrub_stamp":"2024-09-13T18:09:46.350302+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:12.636464+0000","scrub_duration":0.0071307339999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"22'144","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:47.119801+0000","last_change":"2024-09-13T18:09:47.120009+0000","last_active":"2024-09-13T18:09:47.119801+0000","last_peered":"2024-09-13T18:09:47.119801+0000","last_clean":"2024-09-13T18:09:47.119801+0000","last_became_active":"2024-09-13T18:05:26.488542+0000","last_became_peered":"2024-09-13T18:05:26.488542+0000","last_unstale":"2024-09-13T18:09:47.119801+0000","last_undegraded":"2024-09-13T18:09:47.119801+0000","last_fullsized":"2024-09-13T18:09:47.119801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'144","last_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_deep_scrub":"22'144","last_deep_scrub_stamp":"2024-09-13T18:09:47.119752+0000","last_clean_scrub_stamp":"2024-09-13T18:09:47.119752+0000","objects_scrubbed":0,"log_size":144,"log_dups_size":0,"ondisk_log_size":144,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:09.389262+0000","scrub_duration":0.0031522669999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'19","reported_seq":46,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:33.236451+0000","last_change":"2024-09-13T18:09:33.236451+0000","last_active":"2024-09-13T18:09:33.236451+0000","last_peered":"2024-09-13T18:09:33.236451+0000","last_clean":"2024-09-13T18:09:33.236451+0000","last_became_active":"2024-09-13T18:05:26.109429+0000","last_became_peered":"2024-09-13T18:05:26.109429+0000","last_unstale":"2024-09-13T18:09:33.236451+0000","last_undegraded":"2024-09-13T18:09:33.236451+0000","last_fullsized":"2024-09-13T18:09:33.236451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'19","last_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_deep_scrub":"22'19","last_deep_scrub_stamp":"2024-09-13T18:09:33.236168+0000","last_clean_scrub_stamp":"2024-09-13T18:09:33.236168+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:28:32.316160+0000","scrub_duration":0.0077651450000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:42.916418+0000","last_change":"2024-09-13T18:09:42.916418+0000","last_active":"2024-09-13T18:09:42.916418+0000","last_peered":"2024-09-13T18:09:42.916418+0000","last_clean":"2024-09-13T18:09:42.916418+0000","last_became_active":"2024-09-13T18:05:26.487590+0000","last_became_peered":"2024-09-13T18:05:26.487590+0000","last_unstale":"2024-09-13T18:09:42.916418+0000","last_undegraded":"2024-09-13T18:09:42.916418+0000","last_fullsized":"2024-09-13T18:09:42.916418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:42.915992+0000","last_clean_scrub_stamp":"2024-09-13T18:09:42.915992+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:05.185502+0000","scrub_duration":0.0037716170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":138,"num_write_kb":376832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:34.710102+0000","last_change":"2024-09-13T18:09:34.710102+0000","last_active":"2024-09-13T18:09:34.710102+0000","last_peered":"2024-09-13T18:09:34.710102+0000","last_clean":"2024-09-13T18:09:34.710102+0000","last_became_active":"2024-09-13T18:05:26.120106+0000","last_became_peered":"2024-09-13T18:05:26.120106+0000","last_unstale":"2024-09-13T18:09:34.710102+0000","last_undegraded":"2024-09-13T18:09:34.710102+0000","last_fullsized":"2024-09-13T18:09:34.710102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:34.709622+0000","last_clean_scrub_stamp":"2024-09-13T18:09:34.709622+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:27.155464+0000","scrub_duration":0.006819388,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'163","reported_seq":189,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:37.111012+0000","last_change":"2024-09-13T18:09:37.111012+0000","last_active":"2024-09-13T18:09:37.111012+0000","last_peered":"2024-09-13T18:09:37.111012+0000","last_clean":"2024-09-13T18:09:37.111012+0000","last_became_active":"2024-09-13T18:05:26.486568+0000","last_became_peered":"2024-09-13T18:05:26.486568+0000","last_unstale":"2024-09-13T18:09:37.111012+0000","last_undegraded":"2024-09-13T18:09:37.111012+0000","last_fullsized":"2024-09-13T18:09:37.111012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'163","last_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_deep_scrub":"22'163","last_deep_scrub_stamp":"2024-09-13T18:09:37.110762+0000","last_clean_scrub_stamp":"2024-09-13T18:09:37.110762+0000","objects_scrubbed":0,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:59.856602+0000","scrub_duration":0.0030931550000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":156,"num_write_kb":425984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.353833+0000","last_change":"2024-09-13T18:09:48.353833+0000","last_active":"2024-09-13T18:09:48.353833+0000","last_peered":"2024-09-13T18:09:48.353833+0000","last_clean":"2024-09-13T18:09:48.353833+0000","last_became_active":"2024-09-13T18:05:26.118700+0000","last_became_peered":"2024-09-13T18:05:26.118700+0000","last_unstale":"2024-09-13T18:09:48.353833+0000","last_undegraded":"2024-09-13T18:09:48.353833+0000","last_fullsized":"2024-09-13T18:09:48.353833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:48.353503+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.353503+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:44.466201+0000","scrub_duration":0.0064759630000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"22'134","reported_seq":160,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.166659+0000","last_change":"2024-09-13T18:09:39.166659+0000","last_active":"2024-09-13T18:09:39.166659+0000","last_peered":"2024-09-13T18:09:39.166659+0000","last_clean":"2024-09-13T18:09:39.166659+0000","last_became_active":"2024-09-13T18:05:26.479885+0000","last_became_peered":"2024-09-13T18:05:26.479885+0000","last_unstale":"2024-09-13T18:09:39.166659+0000","last_undegraded":"2024-09-13T18:09:39.166659+0000","last_fullsized":"2024-09-13T18:09:39.166659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'134","last_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_deep_scrub":"22'134","last_deep_scrub_stamp":"2024-09-13T18:09:39.166391+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.166391+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:08:21.054493+0000","scrub_duration":0.003674783,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"22'5","reported_seq":32,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:30.194698+0000","last_change":"2024-09-13T18:09:30.194698+0000","last_active":"2024-09-13T18:09:30.194698+0000","last_peered":"2024-09-13T18:09:30.194698+0000","last_clean":"2024-09-13T18:09:30.194698+0000","last_became_active":"2024-09-13T18:05:26.119561+0000","last_became_peered":"2024-09-13T18:05:26.119561+0000","last_unstale":"2024-09-13T18:09:30.194698+0000","last_undegraded":"2024-09-13T18:09:30.194698+0000","last_fullsized":"2024-09-13T18:09:30.194698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'5","last_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_deep_scrub":"22'5","last_deep_scrub_stamp":"2024-09-13T18:09:30.194421+0000","last_clean_scrub_stamp":"2024-09-13T18:09:30.194421+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:27:44.647061+0000","scrub_duration":0.0066843090000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"22'153","reported_seq":179,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:44.866987+0000","last_change":"2024-09-13T18:09:44.866987+0000","last_active":"2024-09-13T18:09:44.866987+0000","last_peered":"2024-09-13T18:09:44.866987+0000","last_clean":"2024-09-13T18:09:44.866987+0000","last_became_active":"2024-09-13T18:05:26.486963+0000","last_became_peered":"2024-09-13T18:05:26.486963+0000","last_unstale":"2024-09-13T18:09:44.866987+0000","last_undegraded":"2024-09-13T18:09:44.866987+0000","last_fullsized":"2024-09-13T18:09:44.866987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'153","last_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_deep_scrub":"22'153","last_deep_scrub_stamp":"2024-09-13T18:09:44.866743+0000","last_clean_scrub_stamp":"2024-09-13T18:09:44.866743+0000","objects_scrubbed":0,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:02.632323+0000","scrub_duration":0.0035320389999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":144,"num_write_kb":393216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"22'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:40.124356+0000","last_change":"2024-09-13T18:09:40.124356+0000","last_active":"2024-09-13T18:09:40.124356+0000","last_peered":"2024-09-13T18:09:40.124356+0000","last_clean":"2024-09-13T18:09:40.124356+0000","last_became_active":"2024-09-13T18:05:26.115994+0000","last_became_peered":"2024-09-13T18:05:26.115994+0000","last_unstale":"2024-09-13T18:09:40.124356+0000","last_undegraded":"2024-09-13T18:09:40.124356+0000","last_fullsized":"2024-09-13T18:09:40.124356+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'2","last_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_deep_scrub":"22'2","last_deep_scrub_stamp":"2024-09-13T18:09:40.124055+0000","last_clean_scrub_stamp":"2024-09-13T18:09:40.124055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:32.569897+0000","scrub_duration":0.0056691459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"22'143","reported_seq":169,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:51.894782+0000","last_change":"2024-09-13T18:09:51.894782+0000","last_active":"2024-09-13T18:09:51.894782+0000","last_peered":"2024-09-13T18:09:51.894782+0000","last_clean":"2024-09-13T18:09:51.894782+0000","last_became_active":"2024-09-13T18:05:26.490321+0000","last_became_peered":"2024-09-13T18:05:26.490321+0000","last_unstale":"2024-09-13T18:09:51.894782+0000","last_undegraded":"2024-09-13T18:09:51.894782+0000","last_fullsized":"2024-09-13T18:09:51.894782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'143","last_scrub_stamp":"2024-09-13T18:09:51.894360+0000","last_deep_scrub":"22'143","last_deep_scrub_stamp":"2024-09-13T18:09:51.894360+0000","last_clean_scrub_stamp":"2024-09-13T18:09:51.894360+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:48.007058+0000","scrub_duration":0.003071126,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":135,"num_write_kb":368640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:45.367333+0000","last_change":"2024-09-13T18:09:45.367333+0000","last_active":"2024-09-13T18:09:45.367333+0000","last_peered":"2024-09-13T18:09:45.367333+0000","last_clean":"2024-09-13T18:09:45.367333+0000","last_became_active":"2024-09-13T18:05:26.115868+0000","last_became_peered":"2024-09-13T18:05:26.115868+0000","last_unstale":"2024-09-13T18:09:45.367333+0000","last_undegraded":"2024-09-13T18:09:45.367333+0000","last_fullsized":"2024-09-13T18:09:45.367333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:45.367056+0000","last_clean_scrub_stamp":"2024-09-13T18:09:45.367056+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:19.207376+0000","scrub_duration":0.0060695089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"22'128","reported_seq":154,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.607128+0000","last_change":"2024-09-13T18:09:48.607128+0000","last_active":"2024-09-13T18:09:48.607128+0000","last_peered":"2024-09-13T18:09:48.607128+0000","last_clean":"2024-09-13T18:09:48.607128+0000","last_became_active":"2024-09-13T18:05:26.495796+0000","last_became_peered":"2024-09-13T18:05:26.495796+0000","last_unstale":"2024-09-13T18:09:48.607128+0000","last_undegraded":"2024-09-13T18:09:48.607128+0000","last_fullsized":"2024-09-13T18:09:48.607128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'128","last_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_deep_scrub":"22'128","last_deep_scrub_stamp":"2024-09-13T18:09:48.606859+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.606859+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:14.893021+0000","scrub_duration":0.0029830960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":123,"num_write_kb":335872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"22'183","reported_seq":209,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:03.036002+0000","last_change":"2024-09-13T18:10:03.036002+0000","last_active":"2024-09-13T18:10:03.036002+0000","last_peered":"2024-09-13T18:10:03.036002+0000","last_clean":"2024-09-13T18:10:03.036002+0000","last_became_active":"2024-09-13T18:05:26.494498+0000","last_became_peered":"2024-09-13T18:05:26.494498+0000","last_unstale":"2024-09-13T18:10:03.036002+0000","last_undegraded":"2024-09-13T18:10:03.036002+0000","last_fullsized":"2024-09-13T18:10:03.036002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'183","last_scrub_stamp":"2024-09-13T18:10:03.035721+0000","last_deep_scrub":"22'183","last_deep_scrub_stamp":"2024-09-13T18:10:03.035721+0000","last_clean_scrub_stamp":"2024-09-13T18:10:03.035721+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:41.242647+0000","scrub_duration":0.0030275829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":168,"num_write_kb":458752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'3","reported_seq":30,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:43.448186+0000","last_change":"2024-09-13T18:09:43.448186+0000","last_active":"2024-09-13T18:09:43.448186+0000","last_peered":"2024-09-13T18:09:43.448186+0000","last_clean":"2024-09-13T18:09:43.448186+0000","last_became_active":"2024-09-13T18:05:26.116200+0000","last_became_peered":"2024-09-13T18:05:26.116200+0000","last_unstale":"2024-09-13T18:09:43.448186+0000","last_undegraded":"2024-09-13T18:09:43.448186+0000","last_fullsized":"2024-09-13T18:09:43.448186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'3","last_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_deep_scrub":"22'3","last_deep_scrub_stamp":"2024-09-13T18:09:43.447804+0000","last_clean_scrub_stamp":"2024-09-13T18:09:43.447804+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:36.964051+0000","scrub_duration":0.0057891319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'141","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:10:10.988553+0000","last_change":"2024-09-13T18:10:10.988553+0000","last_active":"2024-09-13T18:10:10.988553+0000","last_peered":"2024-09-13T18:10:10.988553+0000","last_clean":"2024-09-13T18:10:10.988553+0000","last_became_active":"2024-09-13T18:05:26.490275+0000","last_became_peered":"2024-09-13T18:05:26.490275+0000","last_unstale":"2024-09-13T18:10:10.988553+0000","last_undegraded":"2024-09-13T18:10:10.988553+0000","last_fullsized":"2024-09-13T18:10:10.988553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'141","last_scrub_stamp":"2024-09-13T18:10:10.988311+0000","last_deep_scrub":"22'141","last_deep_scrub_stamp":"2024-09-13T18:10:10.988311+0000","last_clean_scrub_stamp":"2024-09-13T18:10:10.988311+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:08.446912+0000","scrub_duration":0.003300851,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":132,"num_write_kb":360448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'7","reported_seq":34,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.302413+0000","last_change":"2024-09-13T18:09:53.302413+0000","last_active":"2024-09-13T18:09:53.302413+0000","last_peered":"2024-09-13T18:09:53.302413+0000","last_clean":"2024-09-13T18:09:53.302413+0000","last_became_active":"2024-09-13T18:05:26.118770+0000","last_became_peered":"2024-09-13T18:05:26.118770+0000","last_unstale":"2024-09-13T18:09:53.302413+0000","last_undegraded":"2024-09-13T18:09:53.302413+0000","last_fullsized":"2024-09-13T18:09:53.302413+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'7","last_scrub_stamp":"2024-09-13T18:09:53.302131+0000","last_deep_scrub":"22'7","last_deep_scrub_stamp":"2024-09-13T18:09:53.302131+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.302131+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:47:51.640299+0000","scrub_duration":0.0070899999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"22'135","reported_seq":161,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:53.997146+0000","last_change":"2024-09-13T18:09:53.997407+0000","last_active":"2024-09-13T18:09:53.997146+0000","last_peered":"2024-09-13T18:09:53.997146+0000","last_clean":"2024-09-13T18:09:53.997146+0000","last_became_active":"2024-09-13T18:05:26.504486+0000","last_became_peered":"2024-09-13T18:05:26.504486+0000","last_unstale":"2024-09-13T18:09:53.997146+0000","last_undegraded":"2024-09-13T18:09:53.997146+0000","last_fullsized":"2024-09-13T18:09:53.997146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'135","last_scrub_stamp":"2024-09-13T18:09:53.997095+0000","last_deep_scrub":"22'135","last_deep_scrub_stamp":"2024-09-13T18:09:53.997095+0000","last_clean_scrub_stamp":"2024-09-13T18:09:53.997095+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:22.754510+0000","scrub_duration":0.0036090340000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":129,"num_write_kb":352256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'2","reported_seq":29,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:39.898069+0000","last_change":"2024-09-13T18:09:39.898399+0000","last_active":"2024-09-13T18:09:39.898069+0000","last_peered":"2024-09-13T18:09:39.898069+0000","last_clean":"2024-09-13T18:09:39.898069+0000","last_became_active":"2024-09-13T18:05:26.117299+0000","last_became_peered":"2024-09-13T18:05:26.117299+0000","last_unstale":"2024-09-13T18:09:39.898069+0000","last_undegraded":"2024-09-13T18:09:39.898069+0000","last_fullsized":"2024-09-13T18:09:39.898069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'2","last_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_deep_scrub":"20'2","last_deep_scrub_stamp":"2024-09-13T18:09:39.897960+0000","last_clean_scrub_stamp":"2024-09-13T18:09:39.897960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:42.053446+0000","scrub_duration":0.0032269820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'152","reported_seq":178,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:48.907452+0000","last_change":"2024-09-13T18:09:48.907691+0000","last_active":"2024-09-13T18:09:48.907452+0000","last_peered":"2024-09-13T18:09:48.907452+0000","last_clean":"2024-09-13T18:09:48.907452+0000","last_became_active":"2024-09-13T18:05:26.500440+0000","last_became_peered":"2024-09-13T18:05:26.500440+0000","last_unstale":"2024-09-13T18:09:48.907452+0000","last_undegraded":"2024-09-13T18:09:48.907452+0000","last_fullsized":"2024-09-13T18:09:48.907452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'152","last_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_deep_scrub":"22'152","last_deep_scrub_stamp":"2024-09-13T18:09:48.907399+0000","last_clean_scrub_stamp":"2024-09-13T18:09:48.907399+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:15.193562+0000","scrub_duration":0.0033935720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":147,"num_write_kb":401408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'13","reported_seq":40,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-13T18:09:31.063246+0000","last_change":"2024-09-13T18:09:31.063246+0000","last_active":"2024-09-13T18:09:31.063246+0000","last_peered":"2024-09-13T18:09:31.063246+0000","last_clean":"2024-09-13T18:09:31.063246+0000","last_became_active":"2024-09-13T18:05:26.124222+0000","last_became_peered":"2024-09-13T18:05:26.124222+0000","last_unstale":"2024-09-13T18:09:31.063246+0000","last_undegraded":"2024-09-13T18:09:31.063246+0000","last_fullsized":"2024-09-13T18:09:31.063246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'13","last_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_deep_scrub":"22'13","last_deep_scrub_stamp":"2024-09-13T18:09:31.063128+0000","last_clean_scrub_stamp":"2024-09-13T18:09:31.063128+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:51.931136+0000","scrub_duration":0.0086318439999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9216,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9717,"ondisk_log_size":9717,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":222110,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":255,"num_write_kb":310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":444220,"data_compressed":3652,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":0,"internal_metadata":0},"log_size":285,"ondisk_log_size":285,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66158,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":15,"seq":64424509506,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60099999999999998,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.97199999999999998,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60199999999999998,"15min":0.64400000000000002},"min":{"1min":0.47199999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.99099999999999999,"5min":1.097,"15min":1.097},"last":0.66700000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.752,"15min":0.73899999999999999},"min":{"1min":0.52300000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.98599999999999999,"5min":3.0230000000000001,"15min":3.0230000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.47799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.91500000000000004,"5min":3.0510000000000002,"15min":3.0510000000000002},"last":0.873}]},{"osd":3,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.64700000000000002,"15min":0.67100000000000004},"min":{"1min":0.38400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.2509999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.502},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.745,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.308,"15min":0.308},"max":{"1min":1.085,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.73999999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.85999999999999999,"15min":0.88500000000000001},"min":{"1min":0.72499999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.3069999999999999,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.85899999999999999,"15min":0.90000000000000002},"min":{"1min":0.63800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.3380000000000001,"5min":1.516,"15min":1.516},"last":0.89400000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.98799999999999999,"15min":1.022},"min":{"1min":0.71899999999999997,"5min":0.499,"15min":0.499},"max":{"1min":1.3109999999999999,"5min":3.7919999999999998,"15min":3.7919999999999998},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.026,"5min":0.96499999999999997,"15min":1.012},"min":{"1min":0.72899999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.248,"5min":3.4049999999999998,"15min":3.4049999999999998},"last":0.97299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.91900000000000004,"15min":0.98599999999999999},"min":{"1min":0.68500000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.7789999999999999,"5min":1.907,"15min":1.907},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.046,"15min":1.0980000000000001},"min":{"1min":0.82999999999999996,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.3660000000000001,"5min":3.1720000000000002,"15min":3.1720000000000002},"last":0.93200000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.99199999999999999,"15min":1.075},"min":{"1min":0.88800000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.028},{"interface":"front","average":{"1min":1.113,"5min":1.034,"15min":1.0529999999999999},"min":{"1min":0.90800000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.7130000000000001,"5min":4.4539999999999997,"15min":4.4539999999999997},"last":0.95999999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509506,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35452,"kb_used_data":244,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336388,"statfs":{"total":96636764160,"available":96600461312,"internally_reserved":0,"allocated":249856,"data_stored":82286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36043206},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.58599999999999997,"15min":0.628},"min":{"1min":0.497,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.93200000000000005,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.59899999999999998,"15min":0.66100000000000003},"min":{"1min":0.47899999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.94599999999999995,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.71999999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.59199999999999997,"15min":0.622},"min":{"1min":0.40200000000000002,"5min":0.25,"15min":0.25},"max":{"1min":1.0489999999999999,"5min":2.077,"15min":2.077},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.80000000000000004,"15min":0.77100000000000002},"min":{"1min":0.54400000000000004,"5min":0.246,"15min":0.246},"max":{"1min":1.1220000000000001,"5min":11.384,"15min":11.384},"last":0.629}]},{"osd":3,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.76100000000000001,"15min":0.80900000000000005},"min":{"1min":0.63200000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.1120000000000001,"5min":1.9450000000000001,"15min":1.9450000000000001},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.71699999999999997,"15min":0.751},"min":{"1min":0.59799999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.0880000000000001,"5min":2.7229999999999999,"15min":2.7229999999999999},"last":0.87}]},{"osd":4,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.92200000000000004,"15min":0.93799999999999994},"min":{"1min":0.79500000000000004,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.071,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.034,"5min":0.94099999999999995,"15min":0.99099999999999999},"min":{"1min":0.80600000000000005,"5min":0.504,"15min":0.504},"max":{"1min":1.282,"5min":1.347,"15min":1.347},"last":1.0900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.93300000000000005,"15min":0.98499999999999999},"min":{"1min":0.72299999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4390000000000001,"5min":1.452,"15min":1.452},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.94299999999999995,"15min":0.98799999999999999},"min":{"1min":0.73999999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2709999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.97399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.99299999999999999,"15min":1.091},"min":{"1min":0.84899999999999998,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2290000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.026},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.97699999999999998,"15min":1.0389999999999999},"min":{"1min":0.77600000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.373,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.2010000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:10:30 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.014,"15min":1.0880000000000001},"min":{"1min":0.84999999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.252},{"interface":"front","average":{"1min":1.101,"5min":1.04,"15min":1.0800000000000001},"min":{"1min":0.88500000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.3300000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.0509999999999999}]}]},{"osd":7,"up_from":14,"seq":60129542209,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":673561,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76600000000000001,"15min":0.77400000000000002},"min":{"1min":0.60999999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.107,"5min":1.232,"15min":1.232},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":1.0209999999999999},"min":{"1min":0.60499999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.107,"5min":6.093,"15min":6.093},"last":0.91600000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.94899999999999995,"15min":1.125},"min":{"1min":0.61499999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.157,"5min":6.2329999999999997,"15min":6.2329999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.85199999999999998,"15min":0.90200000000000002},"min":{"1min":0.69599999999999995,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1319999999999999,"5min":1.702,"15min":1.702},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.86599999999999999,"15min":0.84799999999999998},"min":{"1min":0.72899999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2669999999999999,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":1},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.99199999999999999,"15min":1.141},"min":{"1min":0.70599999999999996,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.145,"5min":6.1950000000000003,"15min":6.1950000000000003},"last":1.014}]},{"osd":3,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.90300000000000002,"15min":0.85499999999999998},"min":{"1min":0.63700000000000001,"5min":0.435,"15min":0.435},"max":{"1min":1.121,"5min":5.798,"15min":5.798},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.99099999999999999,"15min":0.98299999999999998},"min":{"1min":0.67400000000000004,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1799999999999999,"5min":5.7670000000000003,"15min":5.7670000000000003},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.92900000000000005,"15min":0.97199999999999998},"min":{"1min":0.72799999999999998,"5min":0.375,"15min":0.375},"max":{"1min":1.1080000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1020000000000001,"15min":1.2529999999999999},"min":{"1min":0.82299999999999995,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.222,"5min":5.9969999999999999,"15min":5.9969999999999999},"last":1.1859999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":1.087,"15min":1.23},"min":{"1min":0.74299999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2190000000000001,"5min":7.2160000000000002,"15min":7.2160000000000002},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.135,"15min":1.2709999999999999},"min":{"1min":0.85599999999999998,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.2509999999999999,"5min":5.8440000000000003,"15min":5.8440000000000003},"last":1.0820000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.216,"15min":1.419},"min":{"1min":0.84799999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.288,"5min":7.6870000000000003,"15min":7.6870000000000003},"last":1.113},{"interface":"front","average":{"1min":1.099,"5min":1.0920000000000001,"15min":1.2010000000000001},"min":{"1min":0.94799999999999995,"5min":0.502,"15min":0.502},"max":{"1min":1.3420000000000001,"5min":5.8689999999999998,"15min":5.8689999999999998},"last":0.96499999999999997}]}]},{"osd":6,"up_from":14,"seq":60129542209,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39748,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332092,"statfs":{"total":96636764160,"available":96596062208,"internally_reserved":0,"allocated":454656,"data_stored":299480,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1593,"internal_metadata":40237511},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.77200000000000002,"15min":0.752},"min":{"1min":0.60399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.2490000000000001,"5min":1.286,"15min":1.286},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84799999999999998,"15min":0.80000000000000004},"min":{"1min":0.61299999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.1519999999999999,"5min":2.734,"15min":2.734},"last":0.97599999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.79400000000000004,"15min":0.77500000000000002},"min":{"1min":0.56299999999999994,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.78900000000000003},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.70999999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.87,"15min":0.86399999999999999},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.83499999999999996,"15min":0.84699999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.03,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86099999999999999,"15min":0.88900000000000001},"min":{"1min":0.65200000000000002,"5min":0.433,"15min":0.433},"max":{"1min":1.0820000000000001,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.042},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":0.96099999999999997},"min":{"1min":0.67000000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.2769999999999999,"5min":5.9160000000000004,"15min":5.9160000000000004},"last":0.875}]},{"osd":4,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.88300000000000001,"15min":0.94499999999999995},"min":{"1min":0.66400000000000003,"5min":0.315,"15min":0.315},"max":{"1min":1.1859999999999999,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96299999999999997,"5min":1.0129999999999999,"15min":1.0249999999999999},"min":{"1min":0.61499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.403,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.99399999999999999,"15min":1.0149999999999999},"min":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.155,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.036,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.69499999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.476,"5min":1.859,"15min":1.859},"last":1.105}]},{"osd":7,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.1559999999999999,"15min":1.0880000000000001},"min":{"1min":0.71499999999999997,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.2350000000000001,"5min":7.069,"15min":7.069},"last":1.0760000000000001},{"interface":"front","average":{"1min":1.077,"5min":1.0840000000000001,"15min":1.1220000000000001},"min":{"1min":0.82699999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.234,"5min":1.621,"15min":1.621},"last":1.1259999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542209,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39540,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332300,"statfs":{"total":96636764160,"available":96596275200,"internally_reserved":0,"allocated":241664,"data_stored":82008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.79700000000000004},"min":{"1min":0.40000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0940000000000001,"5min":2.3700000000000001,"15min":2.3700000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.82199999999999995,"15min":0.879},"min":{"1min":0.44800000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.93700000000000006,"5min":2.8159999999999998,"15min":2.8159999999999998},"last":0.754}]},{"osd":1,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.81100000000000005,"15min":0.81699999999999995},"min":{"1min":0.52100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.075,"5min":3.194,"15min":3.194},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.86399999999999999,"15min":0.90200000000000002},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.599,"5min":2.6899999999999999,"15min":2.6899999999999999},"last":1.01}]},{"osd":2,"last update":"Fri Sep 13 18:09:29 2024","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.91100000000000003,"15min":0.95499999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.6000000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.84799999999999998,"15min":0.875},"min":{"1min":0.434,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.823,"5min":1.823,"15min":1.823},"last":0.91000000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96899999999999997,"15min":0.997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.6279999999999999,"5min":3.2890000000000001,"15min":3.2890000000000001},"last":0.875},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.93600000000000005,"15min":0.97499999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1859999999999999,"5min":3.125,"15min":3.125},"last":1.075}]},{"osd":5,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.91500000000000004,"15min":1.002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.1930000000000001,"5min":1.909,"15min":1.909},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0509999999999999,"15min":1.105},"min":{"1min":0.53200000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.679,"5min":2.6179999999999999,"15min":2.6179999999999999},"last":1.1559999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.98299999999999998,"15min":1.0429999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.872,"5min":1.0069999999999999,"15min":1.075},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.2410000000000001,"5min":1.885,"15min":1.885},"last":0.94699999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.083,"15min":1.149},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0760000000000001,"15min":1.165},"min":{"1min":0.378,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.3560000000000001,"5min":1.851,"15min":1.851},"last":1.137}]}]},{"osd":3,"up_from":14,"seq":60129542209,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39756,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332084,"statfs":{"total":96636764160,"available":96596054016,"internally_reserved":0,"allocated":462848,"data_stored":300602,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":1592,"internal_metadata":40237512},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.34899999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.63600000000000001,"15min":0.64000000000000001},"min":{"1min":0.29799999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.59499999999999997,"15min":0.61799999999999999},"min":{"1min":0.27600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.90000000000000002,"5min":1.226,"15min":1.226},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.70599999999999996,"15min":0.69099999999999995},"min":{"1min":0.38900000000000001,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":2.9079999999999999,"5min":2.9079999999999999,"15min":2.9079999999999999},"last":0.90000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":0.79800000000000004,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.7729999999999997,"5min":4.7729999999999997,"15min":4.7729999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.70199999999999996,"15min":0.75},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0469999999999999,"5min":1.798,"15min":1.798},"last":0.77500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.85099999999999998,"15min":0.88100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1339999999999999,"5min":1.359,"15min":1.359},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0549999999999999,"5min":0.98499999999999999,"15min":1.0109999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":0.996}]},{"osd":5,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.96699999999999997},"min":{"1min":0.50600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2629999999999999,"5min":1.905,"15min":1.905},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.95099999999999996},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.2190000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.085,"15min":1.0960000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0469999999999999,"5min":1.012,"15min":1.0589999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":2.6440000000000001,"5min":2.6440000000000001,"15min":2.6440000000000001},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:09:30 2024","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98699999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.085},{"interface":"front","average":{"1min":1.198,"5min":1.103,"15min":1.1020000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":3.1339999999999999,"5min":3.1339999999999999,"15min":3.1339999999999999},"last":1.1279999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":245760,"data_stored":82720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.81799999999999995,"15min":0.85999999999999999},"min":{"1min":0.60699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":1.0820000000000001,"5min":3.1280000000000001,"15min":3.1280000000000001},"last":1.0649999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.76200000000000001,"15min":0.77900000000000003},"min":{"1min":0.57699999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.86199999999999999,"15min":0.83999999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.1520000000000001,"5min":3.2879999999999998,"15min":3.2879999999999998},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.877,"15min":0.94499999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:09:28 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.81999999999999995,"15min":0.83099999999999996},"min":{"1min":0.443,"5min":0.373,"15min":0.373},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.56499999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88700000000000001,"15min":0.92000000000000004},"min":{"1min":0.64700000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.149,"5min":1.962,"15min":1.962},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.879,"5min":0.93999999999999995,"15min":0.89400000000000002},"min":{"1min":0.72799999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.022,"5min":3.3149999999999999,"15min":3.3149999999999999},"last":0.85399999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.84199999999999997,"15min":0.91100000000000003},"min":{"1min":0.65800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.1839999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.89400000000000002,"15min":0.95899999999999996},"min":{"1min":0.59299999999999997,"5min":0.38,"15min":0.38},"max":{"1min":1.224,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.999}]},{"osd":6,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.92700000000000005,"15min":0.93000000000000005},"min":{"1min":0.65800000000000003,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.149,"5min":3.242,"15min":3.242},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.042,"5min":0.98199999999999998,"15min":1.0309999999999999},"min":{"1min":0.80700000000000005,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.262,"5min":1.867,"15min":1.867},"last":1.1060000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:10:25 2024","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":0.998,"15min":1.069},"min":{"1min":0.79700000000000004,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1919999999999999,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0489999999999999,"15min":1.0580000000000001},"min":{"1min":0.73599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.333,"5min":3.343,"15min":3.343},"last":1.1699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":39294,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":307200,"data_stored":672370,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":40237510},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.57699999999999996},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.0720000000000001,"5min":1.214,"15min":1.214},"last":1.113},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.64000000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.83499999999999996,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.505}]},{"osd":2,"last update":"Fri Sep 13 18:09:31 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.64200000000000002,"15min":0.66200000000000003},"min":{"1min":0.28199999999999997,"5min":0.224,"15min":0.224},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":2.2909999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.70999999999999996,"15min":0.75800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.107,"5min":2.27,"15min":2.27},"last":0.91100000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71899999999999997,"15min":0.78300000000000003},"min":{"1min":0.57299999999999995,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.96499999999999997,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73899999999999999,"15min":0.78800000000000003},"min":{"1min":0.54200000000000004,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.012,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88600000000000001,"15min":0.95499999999999996},"min":{"1min":0.74299999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0800000000000001,"5min":3.2160000000000002,"15min":3.2160000000000002},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.92100000000000004,"15min":0.94799999999999995},"min":{"1min":0.64200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.96499999999999997,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.84399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.022,"15min":1.032},"min":{"1min":0.82199999999999995,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.3440000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.032,"5min":0.97999999999999998,"15min":1.05},"min":{"1min":0.75700000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.2090000000000001,"5min":3.0489999999999999,"15min":3.0489999999999999},"last":1.147}]},{"osd":6,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0349999999999999,"15min":1.095},"min":{"1min":0.71499999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3919999999999999,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.877},{"interface":"front","average":{"1min":1.052,"5min":1.0189999999999999,"15min":1.089},"min":{"1min":0.70699999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.296,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.98599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:10:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.96999999999999997,"15min":1.0620000000000001},"min":{"1min":0.70599999999999996,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2589999999999999,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.177},"min":{"1min":0.86699999999999999,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.395,"5min":3.5910000000000002,"15min":3.5910000000000002},"last":1.0289999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33079,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":219260,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":218138,"data_compressed":1826,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T18:10:34.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:10:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 Processor -- start 2024-09-13T18:10:34.512 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 -- start start 2024-09-13T18:10:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5300150190 0x7f53001568b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5300156df0 con 0x7f53000c1820 2024-09-13T18:10:34.513 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53000c6f30 con 0x7f53000c42d0 2024-09-13T18:10:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f53086c9700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5300070d00 con 0x7f5300150190 2024-09-13T18:10:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305c64700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f53000c1820 0x7f530006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54286/0 (socket says 172.21.15.88:54286) 2024-09-13T18:10:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305c64700 1 -- 172.21.15.88:0/1760523263 learned_addr learned my addr 172.21.15.88:0/1760523263 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:34.514 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5306465700 1 --2- 172.21.15.88:0/1760523263 >> v2:172.21.15.94:3300/0 conn(0x7f5300150190 0x7f53001568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367692335 0 0) 0x7f52f0001110 con 0x7f53000c1820 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52ec0035d0 con 0x7f53000c1820 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812443709 0 0) 0x7f52ec0035d0 con 0x7f53000c1820 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5306465700 1 -- 172.21.15.88:0/1760523263 >> v1:172.21.15.94:6789/0 conn(0x7f53000c42d0 legacy=0x7f53000c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5306465700 1 -- 172.21.15.88:0/1760523263 >> v1:172.21.15.88:6789/0 conn(0x7f53000c1820 legacy=0x7f530006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5306465700 1 -- 172.21.15.88:0/1760523263 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53000c63d0 con 0x7f5300150190 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5306465700 1 --2- 172.21.15.88:0/1760523263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300150190 0x7f53001568b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009850 tx=0x7f52fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eaa2f93338cca5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.515 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0001820 con 0x7f5300150190 2024-09-13T18:10:34.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.509+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc004030 con 0x7f5300150190 2024-09-13T18:10:34.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f5305463700 1 -- 172.21.15.88:0/1760523263 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0043c0 con 0x7f5300150190 2024-09-13T18:10:34.516 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- 172.21.15.88:0/1760523263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300150190 msgr2=0x7f53001568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 --2- 172.21.15.88:0/1760523263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300150190 0x7f53001568b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009850 tx=0x7f52fc009b60 comp rx=0 tx=0).stop 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- 172.21.15.88:0/1760523263 shutdown_connections 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 --2- 172.21.15.88:0/1760523263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5300150190 0x7f53001568b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- 172.21.15.88:0/1760523263 >> 172.21.15.88:0/1760523263 conn(0x7f53000c7320 msgr2=0x7f53000c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- 172.21.15.88:0/1760523263 shutdown_connections 2024-09-13T18:10:34.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- 172.21.15.88:0/1760523263 wait complete. 2024-09-13T18:10:34.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 Processor -- start 2024-09-13T18:10:34.518 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.513+0000 7f53086c9700 1 -- start start 2024-09-13T18:10:34.521 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 0x7f530014e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 0x7f530014dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53001e0a90 con 0x7f5300150190 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53001e03f0 con 0x7f53000c42d0 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530006db60 con 0x7f53000c1820 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41244/0 (socket says 172.21.15.88:41244) 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 -- 172.21.15.88:0/1798161689 learned_addr learned my addr 172.21.15.88:0/1798161689 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5305c64700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 0x7f530014dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306465700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 0x7f530014e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 -- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 msgr2=0x7f530014e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 0x7f530014e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.522 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 -- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 msgr2=0x7f530014dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 0x7f530014dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 -- 172.21.15.88:0/1798161689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0094b0 con 0x7f5300150190 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306465700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 0x7f530014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5305c64700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 0x7f530014dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f5306c66700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52f800cbf0 tx=0x7f52f80021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8003c20 con 0x7f5300150190 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f8003d80 con 0x7f5300150190 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53001e0150 con 0x7f5300150190 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800ab80 con 0x7f5300150190 2024-09-13T18:10:34.523 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53001e2000 con 0x7f5300150190 2024-09-13T18:10:34.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.517+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53001e21f0 con 0x7f5300150190 2024-09-13T18:10:34.524 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.521+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f52f800ace0 con 0x7f5300150190 2024-09-13T18:10:34.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.521+0000 7f52f6ffd700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 0x7f52e4068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.521+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f52f80841d0 con 0x7f5300150190 2024-09-13T18:10:34.525 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.521+0000 7f5306465700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 0x7f52e4068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.526 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.521+0000 7f5306465700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 0x7f52e4068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0090b0 tx=0x7f52fc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.532 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.529+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f52f80514c0 con 0x7f5300150190 2024-09-13T18:10:34.703 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.697+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f530006de40 con 0x7f5300150190 2024-09-13T18:10:34.710 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.705+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f52f8001c00 con 0x7f5300150190 2024-09-13T18:10:34.711 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.705+0000 7f52f6ffd700 1 -- 172.21.15.88:0/1798161689 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f52f8054ae0 con 0x7f5300150190 2024-09-13T18:10:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 msgr2=0x7f52e4068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 0x7f52e4068bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0090b0 tx=0x7f52fc008030 comp rx=0 tx=0).stop 2024-09-13T18:10:34.716 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 msgr2=0x7f53001f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f52f800cbf0 tx=0x7f52f80021c0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 shutdown_connections 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f52e4066730 0x7f52e4068bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5300150190 0x7f53001f2450 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f53000c42d0 0x7f530014dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 --2- 172.21.15.88:0/1798161689 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f53000c1820 0x7f530014e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 >> 172.21.15.88:0/1798161689 conn(0x7f53000c7320 msgr2=0x7f5300155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 shutdown_connections 2024-09-13T18:10:34.717 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.713+0000 7f53086c9700 1 -- 172.21.15.88:0/1798161689 wait complete. 2024-09-13T18:10:34.729 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:10:34.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:10:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.837+0000 7fc1e5d18700 1 Processor -- start 2024-09-13T18:10:34.843 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.837+0000 7fc1e5d18700 1 -- start start 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc1e00c3f20 0x7fc1e015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e0153780 con 0x7fc1e01533a0 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1e00c9d20 con 0x7fc1e00c39d0 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e00b20d0 con 0x7fc1e00c3f20 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e4d16700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc1e01533a0 0x7fc1e00cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54302/0 (socket says 172.21.15.88:54302) 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e4d16700 1 -- 172.21.15.88:0/1385768049 learned_addr learned my addr 172.21.15.88:0/1385768049 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:34.844 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> v2:172.21.15.94:3300/0 conn(0x7fc1e00c3f20 0x7fc1e015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120336329 0 0) 0x7fc1e0153780 con 0x7fc1e01533a0 2024-09-13T18:10:34.846 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1c80035d0 con 0x7fc1e01533a0 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1006284883 0 0) 0x7fc1c80035d0 con 0x7fc1e01533a0 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 >> v2:172.21.15.94:3300/0 conn(0x7fc1e00c3f20 msgr2=0x7fc1e015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 --2- 172.21.15.88:0/1385768049 >> v2:172.21.15.94:3300/0 conn(0x7fc1e00c3f20 0x7fc1e015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 >> v1:172.21.15.94:6789/0 conn(0x7fc1e00c39d0 legacy=0x7fc1e0159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00c9760 con 0x7fc1e01533a0 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1615822298 0 0) 0x7fc1dc001670 con 0x7fc1e01533a0 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> v2:172.21.15.94:3300/0 conn(0x7fc1e00c3f20 0x7fc1e015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 >> v1:172.21.15.88:6789/0 conn(0x7fc1e01533a0 legacy=0x7fc1e00cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1c8003a20 0x7fc1c8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1c8005230 0x7fc1c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00b20d0 con 0x7fc1c8004870 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c800c0e0 con 0x7fc1c8005230 2024-09-13T18:10:34.847 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c800c2a0 con 0x7fc1c8003a20 2024-09-13T18:10:34.848 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e4d16700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1c8003a20 0x7fc1c8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5517700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1c8005230 0x7fc1c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 -- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1c8003a20 msgr2=0x7fc1c8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1c8003a20 0x7fc1c8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 -- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1c8005230 msgr2=0x7fc1c800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1c8005230 0x7fc1c800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 -- 172.21.15.88:0/1385768049 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80035d0 con 0x7fc1c8004870 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5517700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1c8005230 0x7fc1c800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5517700 1 -- 172.21.15.88:0/1385768049 reap_dead start 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1c8004cf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009d40 tx=0x7fc1c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a87c22103b9b72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0009e90 con 0x7fc1c8004870 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1d000e9a0 con 0x7fc1c8004870 2024-09-13T18:10:34.849 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1d77fe700 1 -- 172.21.15.88:0/1385768049 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d000ed30 con 0x7fc1c8004870 2024-09-13T18:10:34.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 msgr2=0x7fc1c8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1c8004cf0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009d40 tx=0x7fc1c80058a0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- 172.21.15.88:0/1385768049 shutdown_connections 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/1385768049 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1c8004cf0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- 172.21.15.88:0/1385768049 >> 172.21.15.88:0/1385768049 conn(0x7fc1e0071800 msgr2=0x7fc1e0071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.841+0000 7fc1e5d18700 1 -- 172.21.15.88:0/1385768049 shutdown_connections 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 -- 172.21.15.88:0/1385768049 wait complete. 2024-09-13T18:10:34.853 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 Processor -- start 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 -- start start 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0157340 0x7fc1e01f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 0x7fc1e00c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e0157de0 con 0x7fc1c8004870 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e00cccd0 con 0x7fc1e0157340 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5d18700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e01f1d40 con 0x7fc1e00cc850 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41256/0 (socket says 172.21.15.88:41256) 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 -- 172.21.15.88:0/3427758361 learned_addr learned my addr 172.21.15.88:0/3427758361 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0157340 0x7fc1e01f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5517700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 0x7fc1e00c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 -- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 msgr2=0x7fc1e00c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.854 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 0x7fc1e00c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 -- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0157340 msgr2=0x7fc1e01f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0157340 0x7fc1e01f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e4d16700 1 -- 172.21.15.88:0/3427758361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e01e2450 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.845+0000 7fc1e5517700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 0x7fc1e00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1e4d16700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0017a0 tx=0x7fc1dc007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc001500 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc1dc00f660 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e0157ff0 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1dc00fa10 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e01f22e0 con 0x7fc1c8004870 2024-09-13T18:10:34.855 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e015cf50 con 0x7fc1c8004870 2024-09-13T18:10:34.856 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:10:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.849+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fc1dc00fb70 con 0x7fc1c8004870 2024-09-13T18:10:34.857 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.853+0000 7fc1d57fa700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 0x7fc1cc068c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.853+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc1dc0842c0 con 0x7fc1c8004870 2024-09-13T18:10:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.853+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 0x7fc1cc068c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:34.858 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.853+0000 7fc1d7fff700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 0x7fc1cc068c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00090b0 tx=0x7fc1d001e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:34.863 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:34.861+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fc1dc051500 con 0x7fc1c8004870 2024-09-13T18:10:35.069 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.065+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e00700d0 con 0x7fc1c8004870 2024-09-13T18:10:35.070 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.065+0000 7fc1d57fa700 1 -- 172.21.15.88:0/3427758361 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7fc1dc054b20 con 0x7fc1c8004870 2024-09-13T18:10:35.070 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:10:35.070 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:10:35.072 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 msgr2=0x7fc1cc068c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 0x7fc1cc068c40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00090b0 tx=0x7fc1d001e040 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 msgr2=0x7fc1e01ee7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc0017a0 tx=0x7fc1dc007550 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 shutdown_connections 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fc1cc066780 0x7fc1cc068c40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1e00cc850 0x7fc1e00c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1e0157340 0x7fc1e01f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 --2- 172.21.15.88:0/3427758361 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1c8004870 0x7fc1e01ee7d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 >> 172.21.15.88:0/3427758361 conn(0x7fc1e0071800 msgr2=0x7fc1e0156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 shutdown_connections 2024-09-13T18:10:35.073 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.069+0000 7fc1e5d18700 1 -- 172.21.15.88:0/3427758361 wait complete. 2024-09-13T18:10:35.074 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:10:35.086 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:10:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 Processor -- start 2024-09-13T18:10:35.204 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 -- start start 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c08150b30 0x7f4c0806e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f4c0806f6a0 0x7f4c0806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0806dce0 con 0x7f4c080c3e30 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0806e010 con 0x7f4c08150b30 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c0c919700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c0806d140 con 0x7f4c0806f6a0 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c07fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4c080c3e30 0x7f4c0815a210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54308/0 (socket says 172.21.15.88:54308) 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c07fff700 1 -- 172.21.15.88:0/3424910411 learned_addr learned my addr 172.21.15.88:0/3424910411 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 --2- 172.21.15.88:0/3424910411 >> v2:172.21.15.88:3300/0 conn(0x7f4c08150b30 0x7f4c0806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c06ffd700 1 --2- 172.21.15.88:0/3424910411 >> v2:172.21.15.94:3300/0 conn(0x7f4c0806f6a0 0x7f4c0806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c067fc700 1 -- 172.21.15.88:0/3424910411 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747365596 0 0) 0x7f4c0806dce0 con 0x7f4c080c3e30 2024-09-13T18:10:35.207 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c067fc700 1 -- 172.21.15.88:0/3424910411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be80035d0 con 0x7f4c080c3e30 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 -- 172.21.15.88:0/3424910411 >> v2:172.21.15.94:3300/0 conn(0x7f4c0806f6a0 msgr2=0x7f4c0806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 --2- 172.21.15.88:0/3424910411 >> v2:172.21.15.94:3300/0 conn(0x7f4c0806f6a0 0x7f4c0806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 -- 172.21.15.88:0/3424910411 >> v1:172.21.15.88:6789/0 conn(0x7f4c080c3e30 legacy=0x7f4c0815a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 -- 172.21.15.88:0/3424910411 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0806bcb0 con 0x7f4c08150b30 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c077fe700 1 --2- 172.21.15.88:0/3424910411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c08150b30 0x7f4c0806e430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806bea0 tx=0x7f4bf8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a870ce526ba8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c067fc700 1 -- 172.21.15.88:0/3424910411 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8004020 con 0x7f4c08150b30 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c067fc700 1 -- 172.21.15.88:0/3424910411 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bf8004180 con 0x7f4c08150b30 2024-09-13T18:10:35.208 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.201+0000 7f4c067fc700 1 -- 172.21.15.88:0/3424910411 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8004510 con 0x7f4c08150b30 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/3424910411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c08150b30 msgr2=0x7f4c0806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- 172.21.15.88:0/3424910411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c08150b30 0x7f4c0806e430 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4c0806bea0 tx=0x7f4bf8009b30 comp rx=0 tx=0).stop 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/3424910411 shutdown_connections 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- 172.21.15.88:0/3424910411 >> v2:172.21.15.94:3300/0 conn(0x7f4c0806f6a0 0x7f4c0806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- 172.21.15.88:0/3424910411 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c08150b30 0x7f4c0806e430 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.210 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/3424910411 >> 172.21.15.88:0/3424910411 conn(0x7f4c080ca720 msgr2=0x7f4c080cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/3424910411 shutdown_connections 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/3424910411 wait complete. 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 Processor -- start 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- start start 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c0806f6a0 0x7f4c08153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4c08150b30 0x7f4c08149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c36b0 con 0x7f4c080c3e30 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c3be0 con 0x7f4c0806f6a0 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c080c3900 con 0x7f4c08150b30 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41274/0 (socket says 172.21.15.88:41274) 2024-09-13T18:10:35.211 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 -- 172.21.15.88:0/2703035176 learned_addr learned my addr 172.21.15.88:0/2703035176 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c077fe700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c0806f6a0 0x7f4c08153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c07fff700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4c08150b30 0x7f4c08149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 -- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4c08150b30 msgr2=0x7f4c08149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4c08150b30 0x7f4c08149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 -- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c0806f6a0 msgr2=0x7f4c08153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c0806f6a0 0x7f4c08153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 -- 172.21.15.88:0/2703035176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80094b0 con 0x7f4c080c3e30 2024-09-13T18:10:35.212 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c06ffd700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000e840 tx=0x7f4bf000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf00095a0 con 0x7f4c080c3e30 2024-09-13T18:10:35.213 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bf0013680 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c080c1cc0 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0013a10 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.205+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c080c2280 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c08074940 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f4bf0013b70 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4bfffff700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 0x7f4bec068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4bf0084050 con 0x7f4c080c3e30 2024-09-13T18:10:35.214 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4c077fe700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 0x7f4bec068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.215 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.209+0000 7f4c077fe700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 0x7f4bec068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.222 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.217+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f4bf0051340 con 0x7f4c080c3e30 2024-09-13T18:10:35.429 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.425+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c0806b900 con 0x7f4c080c3e30 2024-09-13T18:10:35.430 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.425+0000 7f4bfffff700 1 -- 172.21.15.88:0/2703035176 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6266 (secure 0 0 0) 0x7f4bf0054960 con 0x7f4c080c3e30 2024-09-13T18:10:35.431 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:10:35.431 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4227,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6833/3779855223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3779855223},{"type":"v1","addr":"172.21.15.88:6833","nonce":3779855223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6837/2826537641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6835","nonce":2826537641},{"type":"v1","addr":"172.21.15.94:6837","nonce":2826537641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4248,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/176731919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":176731919},{"type":"v1","addr":"172.21.15.88:6835","nonce":176731919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:05:26.465742+0000","modified":"2024-09-13T18:05:43.557503+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4294,"mds_1":4285,"mds_2":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.88:6837/4078470559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6836","nonce":4078470559},{"type":"v1","addr":"172.21.15.88:6837","nonce":4078470559}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4285":{"gid":4285,"name":"f","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.94:6836/135986553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":135986553},{"type":"v1","addr":"172.21.15.94:6836","nonce":135986553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4294":{"gid":4294,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.94:6839/2424350454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6838","nonce":2424350454},{"type":"v1","addr":"172.21.15.94:6839","nonce":2424350454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 msgr2=0x7f4bec068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 0x7f4bec068c20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4bf80090b0 tx=0x7f4bf8008030 comp rx=0 tx=0).stop 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 msgr2=0x7f4c080c2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000e840 tx=0x7f4bf000eb50 comp rx=0 tx=0).stop 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 shutdown_connections 2024-09-13T18:10:35.433 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f4bec066760 0x7f4bec068c20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4c08150b30 0x7f4c08149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c080c3e30 0x7f4c080c2a80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 --2- 172.21.15.88:0/2703035176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4c0806f6a0 0x7f4c08153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 >> 172.21.15.88:0/2703035176 conn(0x7f4c080ca720 msgr2=0x7f4c080c68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 shutdown_connections 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.429+0000 7f4c0c919700 1 -- 172.21.15.88:0/2703035176 wait complete. 2024-09-13T18:10:35.434 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 12 2024-09-13T18:10:35.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:10:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 Processor -- start 2024-09-13T18:10:35.560 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- start start 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6950159100 0x7f69500c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6950071720 0x7f6950071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500c18f0 con 0x7f695014fdb0 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6950159520 con 0x7f6950071720 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69501560a0 con 0x7f6950159100 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6950071720 0x7f6950071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6950071720 0x7f6950071bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41288/0 (socket says 172.21.15.88:41288) 2024-09-13T18:10:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 -- 172.21.15.88:0/175350469 learned_addr learned my addr 172.21.15.88:0/175350469 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f694ffff700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6950159100 0x7f69500c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 -- 172.21.15.88:0/175350469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6950159100 msgr2=0x7f69500c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6950159100 0x7f69500c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 -- 172.21.15.88:0/175350469 >> v1:172.21.15.94:6789/0 conn(0x7f695014fdb0 legacy=0x7f6950156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 -- 172.21.15.88:0/175350469 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950159fe0 con 0x7f6950071720 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f69552ce700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950071720 0x7f6950071bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6948009910 tx=0x7f6948009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba36c2e659931654 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f694f7fe700 1 -- 172.21.15.88:0/175350469 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800ba60 con 0x7f6950071720 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f694f7fe700 1 -- 172.21.15.88:0/175350469 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f694800bbc0 con 0x7f6950071720 2024-09-13T18:10:35.563 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f694f7fe700 1 -- 172.21.15.88:0/175350469 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948009e60 con 0x7f6950071720 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- 172.21.15.88:0/175350469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950071720 msgr2=0x7f6950071bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950071720 0x7f6950071bb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6948009910 tx=0x7f6948009c20 comp rx=0 tx=0).stop 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- 172.21.15.88:0/175350469 shutdown_connections 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950071720 0x7f6950071bb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 --2- 172.21.15.88:0/175350469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6950159100 0x7f69500c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- 172.21.15.88:0/175350469 >> 172.21.15.88:0/175350469 conn(0x7f69500ca720 msgr2=0x7f69500cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.564 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- 172.21.15.88:0/175350469 shutdown_connections 2024-09-13T18:10:35.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.557+0000 7f6955acf700 1 -- 172.21.15.88:0/175350469 wait complete. 2024-09-13T18:10:35.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 Processor -- start 2024-09-13T18:10:35.565 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 -- start start 2024-09-13T18:10:35.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 0x7f69501587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 0x7f69500c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.567 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6950158cf0 con 0x7f6950159100 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695014a380 con 0x7f6950071720 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6955acf700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500ca130 con 0x7f695014fdb0 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41304/0 (socket says 172.21.15.88:41304) 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 -- 172.21.15.88:0/197919079 learned_addr learned my addr 172.21.15.88:0/197919079 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f694ffff700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 0x7f69500c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6954acd700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 0x7f69501587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 -- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 msgr2=0x7f69500c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 0x7f69500c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 -- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 msgr2=0x7f69501587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 0x7f69501587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 -- 172.21.15.88:0/197919079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009570 con 0x7f6950159100 2024-09-13T18:10:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f694ffff700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 0x7f69500c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f6954acd700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 0x7f69501587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f69552ce700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6948009c60 tx=0x7f6948004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948004550 con 0x7f6950159100 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.561+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f694801f070 con 0x7f6950159100 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500c95e0 con 0x7f6950159100 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948003920 con 0x7f6950159100 2024-09-13T18:10:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6950157a80 con 0x7f6950159100 2024-09-13T18:10:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6950157c70 con 0x7f6950159100 2024-09-13T18:10:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f6948003a80 con 0x7f6950159100 2024-09-13T18:10:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f694d7fa700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 0x7f693c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.565+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6948021070 con 0x7f6950159100 2024-09-13T18:10:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.569+0000 7f6954acd700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 0x7f693c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.572 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.569+0000 7f6954acd700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 0x7f693c068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6944000f60 tx=0x7f6944009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.569+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f69480531d0 con 0x7f6950159100 2024-09-13T18:10:35.751 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.745+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6950150190 con 0x7f6950159100 2024-09-13T18:10:35.753 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.749+0000 7f694d7fa700 1 -- 172.21.15.88:0/197919079 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16646 (secure 0 0 0) 0x7f6948015090 con 0x7f6950159100 2024-09-13T18:10:35.754 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-09-13T18:10:35.754 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":22,"fsid":"70755675-8bb0-445c-8ac9-8148c6ab712e","created":"2024-09-13T18:05:09.739130+0000","modified":"2024-09-13T18:06:16.706465+0000","last_up_change":"2024-09-13T18:05:20.051014+0000","last_in_change":"2024-09-13T18:05:11.851494+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:05:19.011922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:05:24.919545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:05:25.460502+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7642ce31-b465-4ddc-941a-5f9e2cd29ea5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6801","nonce":3777001302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6803","nonce":3777001302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6807","nonce":3777001302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":3777001302},{"type":"v1","addr":"172.21.15.88:6805","nonce":3777001302}]},"public_addr":"172.21.15.88:6801/3777001302","cluster_addr":"172.21.15.88:6803/3777001302","heartbeat_back_addr":"172.21.15.88:6807/3777001302","heartbeat_front_addr":"172.21.15.88:6805/3777001302","state":["exists","up"]},{"osd":1,"uuid":"f91b2977-4a3d-45c1-82e1-acf5ea0406dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6825","nonce":1509066892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6827","nonce":1509066892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6831","nonce":1509066892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":1509066892},{"type":"v1","addr":"172.21.15.88:6829","nonce":1509066892}]},"public_addr":"172.21.15.88:6825/1509066892","cluster_addr":"172.21.15.88:6827/1509066892","heartbeat_back_addr":"172.21.15.88:6831/1509066892","heartbeat_front_addr":"172.21.15.88:6829/1509066892","state":["exists","up"]},{"osd":2,"uuid":"062d570d-ebc4-400a-adbf-57fc169f2e40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6817","nonce":3613472173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6819","nonce":3613472173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6823","nonce":3613472173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":3613472173},{"type":"v1","addr":"172.21.15.88:6821","nonce":3613472173}]},"public_addr":"172.21.15.88:6817/3613472173","cluster_addr":"172.21.15.88:6819/3613472173","heartbeat_back_addr":"172.21.15.88:6823/3613472173","heartbeat_front_addr":"172.21.15.88:6821/3613472173","state":["exists","up"]},{"osd":3,"uuid":"d75ac126-5892-4429-a31a-e19dc06bda6c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6809","nonce":3817728966}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6811","nonce":3817728966}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6815","nonce":3817728966}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":3817728966},{"type":"v1","addr":"172.21.15.88:6813","nonce":3817728966}]},"public_addr":"172.21.15.88:6809/3817728966","cluster_addr":"172.21.15.88:6811/3817728966","heartbeat_back_addr":"172.21.15.88:6815/3817728966","heartbeat_front_addr":"172.21.15.88:6813/3817728966","state":["exists","up"]},{"osd":4,"uuid":"c0ee9a97-1888-4ccc-af94-07dae043cd86","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6801","nonce":1669353113}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6803","nonce":1669353113}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6807","nonce":1669353113}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":1669353113},{"type":"v1","addr":"172.21.15.94:6805","nonce":1669353113}]},"public_addr":"172.21.15.94:6801/1669353113","cluster_addr":"172.21.15.94:6803/1669353113","heartbeat_back_addr":"172.21.15.94:6807/1669353113","heartbeat_front_addr":"172.21.15.94:6805/1669353113","state":["exists","up"]},{"osd":5,"uuid":"52de53d5-cf57-4a22-8b19-b0f8ca20a920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6816","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6817","nonce":2317600927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6819","nonce":2317600927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6822","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6823","nonce":2317600927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6820","nonce":2317600927},{"type":"v1","addr":"172.21.15.94:6821","nonce":2317600927}]},"public_addr":"172.21.15.94:6817/2317600927","cluster_addr":"172.21.15.94:6819/2317600927","heartbeat_back_addr":"172.21.15.94:6823/2317600927","heartbeat_front_addr":"172.21.15.94:6821/2317600927","state":["exists","up"]},{"osd":6,"uuid":"200d2417-675c-47c3-ab97-98ab8b02bc55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6825","nonce":1539943625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6827","nonce":1539943625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6831","nonce":1539943625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":1539943625},{"type":"v1","addr":"172.21.15.94:6829","nonce":1539943625}]},"public_addr":"172.21.15.94:6825/1539943625","cluster_addr":"172.21.15.94:6827/1539943625","heartbeat_back_addr":"172.21.15.94:6831/1539943625","heartbeat_front_addr":"172.21.15.94:6829/1539943625","state":["exists","up"]},{"osd":7,"uuid":"96a9d816-3dbf-4c9b-a672-6dce5b439c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6809","nonce":594133881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6811","nonce":594133881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6815","nonce":594133881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6812","nonce":594133881},{"type":"v1","addr":"172.21.15.94:6813","nonce":594133881}]},"public_addr":"172.21.15.94:6809/594133881","cluster_addr":"172.21.15.94:6811/594133881","heartbeat_back_addr":"172.21.15.94:6815/594133881","heartbeat_front_addr":"172.21.15.94:6813/594133881","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.911344+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.252631+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.214015+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.329569+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.995573+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:16.680541+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.370010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:05:17.179186+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.12","mappings":[{"from":0,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 msgr2=0x7f693c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 0x7f693c068bf0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6944000f60 tx=0x7f6944009040 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 msgr2=0x7f69500c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6948009c60 tx=0x7f6948004770 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 shutdown_connections 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f693c066730 0x7f693c068bf0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f695014fdb0 0x7f69500c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6950159100 0x7f69500c8be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 --2- 172.21.15.88:0/197919079 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6950071720 0x7f69501587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.756 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 >> 172.21.15.88:0/197919079 conn(0x7f69500ca720 msgr2=0x7f695006f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 shutdown_connections 2024-09-13T18:10:35.757 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.753+0000 7f6955acf700 1 -- 172.21.15.88:0/197919079 wait complete. 2024-09-13T18:10:35.768 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:10:35.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 Processor -- start 2024-09-13T18:10:35.889 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 -- start start 2024-09-13T18:10:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 0x7f232c0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f232c156130 con 0x7f232c0c14d0 2024-09-13T18:10:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f232c156410 con 0x7f232c0c7740 2024-09-13T18:10:35.890 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2333269700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1566f0 con 0x7f232c0c7360 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2331a66700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 0x7f232c0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:46656/0 (socket says 172.21.15.88:46656) 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2331a66700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 0x7f232c0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:33002/0 (socket says 172.21.15.88:33002) 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 -- 172.21.15.88:0/1495621213 learned_addr learned my addr 172.21.15.88:0/1495621213 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 -- 172.21.15.88:0/1495621213 >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 msgr2=0x7f232c0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 --2- 172.21.15.88:0/1495621213 >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 0x7f232c0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 -- 172.21.15.88:0/1495621213 >> v1:172.21.15.94:6789/0 conn(0x7f232c0c14d0 legacy=0x7f232c14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.891 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.885+0000 7f2332267700 1 -- 172.21.15.88:0/1495621213 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c1569d0 con 0x7f232c0c7360 2024-09-13T18:10:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2332267700 1 --2- 172.21.15.88:0/1495621213 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2324009e50 tx=0x7f232400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8bdc39be1f71ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2331265700 1 -- 172.21.15.88:0/1495621213 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400e070 con 0x7f232c0c7360 2024-09-13T18:10:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2331265700 1 -- 172.21.15.88:0/1495621213 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f232400b910 con 0x7f232c0c7360 2024-09-13T18:10:35.892 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2331265700 1 -- 172.21.15.88:0/1495621213 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400bce0 con 0x7f232c0c7360 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- 172.21.15.88:0/1495621213 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 msgr2=0x7f232c155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 --2- 172.21.15.88:0/1495621213 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2324009e50 tx=0x7f232400b330 comp rx=0 tx=0).stop 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- 172.21.15.88:0/1495621213 shutdown_connections 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 --2- 172.21.15.88:0/1495621213 >> v2:172.21.15.94:3300/0 conn(0x7f232c0c7740 0x7f232c0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 --2- 172.21.15.88:0/1495621213 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7360 0x7f232c155b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- 172.21.15.88:0/1495621213 >> 172.21.15.88:0/1495621213 conn(0x7f232c0664b0 msgr2=0x7f232c06eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:35.893 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- 172.21.15.88:0/1495621213 shutdown_connections 2024-09-13T18:10:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- 172.21.15.88:0/1495621213 wait complete. 2024-09-13T18:10:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 Processor -- start 2024-09-13T18:10:35.894 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.889+0000 7f2333269700 1 -- start start 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232c0c7360 0x7f232c1ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7740 0x7f232c149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c071680 con 0x7f232c0c14d0 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c0718e0 con 0x7f232c0c7360 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f232c14b7e0 con 0x7f232c0c7740 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41312/0 (socket says 172.21.15.88:41312) 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 -- 172.21.15.88:0/422005424 learned_addr learned my addr 172.21.15.88:0/422005424 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2331a66700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232c0c7360 0x7f232c1ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.897 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332a68700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7740 0x7f232c149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 -- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7740 msgr2=0x7f232c149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7740 0x7f232c149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 -- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232c0c7360 msgr2=0x7f232c1ef9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232c0c7360 0x7f232c1ef9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 -- 172.21.15.88:0/422005424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324009b30 con 0x7f232c0c14d0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2332267700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f232400b370 tx=0x7f2324004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324004250 con 0x7f232c0c14d0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c071b80 con 0x7f232c0c14d0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f23240043b0 con 0x7f232c0c14d0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324004780 con 0x7f232c0c14d0 2024-09-13T18:10:35.898 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c14bf10 con 0x7f232c0c14d0 2024-09-13T18:10:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c153d00 con 0x7f232c0c14d0 2024-09-13T18:10:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f232401c440 con 0x7f232c0c14d0 2024-09-13T18:10:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.893+0000 7f2322ffd700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 0x7f2310068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.897+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f23240857c0 con 0x7f232c0c14d0 2024-09-13T18:10:35.899 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.897+0000 7f2331a66700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 0x7f2310068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:35.900 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.897+0000 7f2331a66700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 0x7f2310068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f232c14f500 tx=0x7f2328009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:35.901+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f2324052ac0 con 0x7f232c0c14d0 2024-09-13T18:10:36.114 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.109+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f232c155b10 con 0x7f232c0c14d0 2024-09-13T18:10:36.127 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2322ffd700 1 -- 172.21.15.88:0/422005424 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v13) v1 ==== 161+0+0 (secure 0 0 0) 0x7f23240560e0 con 0x7f232c0c14d0 2024-09-13T18:10:36.130 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 msgr2=0x7f2310068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 0x7f2310068bf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f232c14f500 tx=0x7f2328009240 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 msgr2=0x7f232c14b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f232400b370 tx=0x7f2324004af0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 shutdown_connections 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f2310066730 0x7f2310068bf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f232c0c7740 0x7f232c149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f232c0c7360 0x7f232c1ef9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 --2- 172.21.15.88:0/422005424 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f232c0c14d0 0x7f232c14b2a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 >> 172.21.15.88:0/422005424 conn(0x7f232c0664b0 msgr2=0x7f232c06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 shutdown_connections 2024-09-13T18:10:36.131 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.125+0000 7f2333269700 1 -- 172.21.15.88:0/422005424 wait complete. 2024-09-13T18:10:36.132 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:10:36.142 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:10:36.168 INFO:tasks.ceph.mds.e.smithi088.stdout:starting mds.e at 2024-09-13T18:10:36.180 INFO:tasks.ceph.mds.f.smithi094.stdout:starting mds.f at 2024-09-13T18:10:36.196 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2024-09-13T18:10:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 Processor -- start 2024-09-13T18:10:36.256 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- start start 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f439c06f8b0 0x7f439c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c0cb600 con 0x7f439c157190 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c161120 con 0x7f439c0c8690 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c0700b0 con 0x7f439c06f8b0 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439a59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f439c157190 0x7f439c15dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54336/0 (socket says 172.21.15.88:54336) 2024-09-13T18:10:36.257 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439a59c700 1 -- 172.21.15.88:0/1295306211 learned_addr learned my addr 172.21.15.88:0/1295306211 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f4399d9b700 1 --2- 172.21.15.88:0/1295306211 >> v2:172.21.15.94:3300/0 conn(0x7f439c06f8b0 0x7f439c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776787950 0 0) 0x7f4390001110 con 0x7f439c157190 2024-09-13T18:10:36.258 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43840035d0 con 0x7f439c157190 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f4399d9b700 1 -- 172.21.15.88:0/1295306211 >> v1:172.21.15.94:6789/0 conn(0x7f439c0c8690 legacy=0x7f439c167b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f4399d9b700 1 -- 172.21.15.88:0/1295306211 >> v1:172.21.15.88:6789/0 conn(0x7f439c157190 legacy=0x7f439c15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 898022950 0 0) 0x7f43840035d0 con 0x7f439c157190 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f4399d9b700 1 -- 172.21.15.88:0/1295306211 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c070390 con 0x7f439c06f8b0 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f4399d9b700 1 --2- 172.21.15.88:0/1295306211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c61a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f438c009d90 tx=0x7f438c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbca8b336dca6534 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00e070 con 0x7f439c06f8b0 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f438c003a40 con 0x7f439c06f8b0 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439959a700 1 -- 172.21.15.88:0/1295306211 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390001800 con 0x7f439c06f8b0 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- 172.21.15.88:0/1295306211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 msgr2=0x7f439c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.259 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 --2- 172.21.15.88:0/1295306211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c61a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f438c009d90 tx=0x7f438c00b330 comp rx=0 tx=0).stop 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- 172.21.15.88:0/1295306211 shutdown_connections 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 --2- 172.21.15.88:0/1295306211 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c61a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- 172.21.15.88:0/1295306211 >> 172.21.15.88:0/1295306211 conn(0x7f439c06a820 msgr2=0x7f439c06ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- 172.21.15.88:0/1295306211 shutdown_connections 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.253+0000 7f439b59e700 1 -- 172.21.15.88:0/1295306211 wait complete. 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 Processor -- start 2024-09-13T18:10:36.260 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 -- start start 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 0x7f439c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c6a40 con 0x7f439c0c8690 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c150590 con 0x7f439c06f8b0 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0c3b20 con 0x7f439c157190 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439a59c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:36.264 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41336/0 (socket says 172.21.15.88:41336) 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 -- 172.21.15.88:0/270273891 learned_addr learned my addr 172.21.15.88:0/270273891 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439ad9d700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 0x7f439c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 -- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 msgr2=0x7f439c150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 0x7f439c150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 -- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 msgr2=0x7f439c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 -- 172.21.15.88:0/270273891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c009a70 con 0x7f439c0c8690 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f439ad9d700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 0x7f439c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.257+0000 7f4399d9b700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f438c000f80 tx=0x7f438c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c004730 con 0x7f439c0c8690 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f438c0048b0 con 0x7f439c0c8690 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c0c3e00 con 0x7f439c0c8690 2024-09-13T18:10:36.265 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c012690 con 0x7f439c0c8690 2024-09-13T18:10:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0c43c0 con 0x7f439c0c8690 2024-09-13T18:10:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c070de0 con 0x7f439c0c8690 2024-09-13T18:10:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f438c0127f0 con 0x7f439c0c8690 2024-09-13T18:10:36.266 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 0x7f437c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:36.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f438c085680 con 0x7f439c0c8690 2024-09-13T18:10:36.267 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.261+0000 7f439a59c700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 0x7f437c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:36.268 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.265+0000 7f439a59c700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 0x7f437c068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4390004a30 tx=0x7f43900017f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:36.275 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.273+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f438c0527e0 con 0x7f439c0c8690 2024-09-13T18:10:36.484 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:36.481+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f439c161590 con 0x7f439c0c8690 2024-09-13T18:10:37.133 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.129+0000 7f438affd700 1 -- 172.21.15.88:0/270273891 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f439c161590 con 0x7f439c0c8690 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 msgr2=0x7f437c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 0x7f437c068bf0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4390004a30 tx=0x7f43900017f0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 msgr2=0x7f439c0c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f438c000f80 tx=0x7f438c004af0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 shutdown_connections 2024-09-13T18:10:37.137 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f437c066730 0x7f437c068bf0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f439c157190 0x7f439c150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f439c0c8690 0x7f439c0c7260 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 --2- 172.21.15.88:0/270273891 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f439c06f8b0 0x7f439c0c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 >> 172.21.15.88:0/270273891 conn(0x7f439c06a820 msgr2=0x7f439c06c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 shutdown_connections 2024-09-13T18:10:37.138 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.133+0000 7f439b59e700 1 -- 172.21.15.88:0/270273891 wait complete. 2024-09-13T18:10:37.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:10:37.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.321+0000 7f3f7b59e700 1 Processor -- start 2024-09-13T18:10:37.327 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.321+0000 7f3f7b59e700 1 -- start start 2024-09-13T18:10:37.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c159820 con 0x7f3f7c1531a0 2024-09-13T18:10:37.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c0b1e20 con 0x7f3f7c0ca420 2024-09-13T18:10:37.328 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0c7690 con 0x7f3f7c159390 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f79d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f79d9b700 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.88:33060/0 (socket says 172.21.15.88:33060) 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7a59c700 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f3f7c1531a0 0x7f3f7c06b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.88:46882/0 (socket says 172.21.15.88:46882) 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.88:46698/0 (socket says 172.21.15.88:46698) 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f79d9b700 1 -- 172.21.15.88:0/3776116228 learned_addr learned my addr 172.21.15.88:0/3776116228 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 -- 172.21.15.88:0/3776116228 >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 msgr2=0x7f3f7c158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 --2- 172.21.15.88:0/3776116228 >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 -- 172.21.15.88:0/3776116228 >> v1:172.21.15.94:6789/0 conn(0x7f3f7c1531a0 legacy=0x7f3f7c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 -- 172.21.15.88:0/3776116228 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0c7c50 con 0x7f3f7c159390 2024-09-13T18:10:37.330 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7959a700 1 -- 172.21.15.88:0/3776116228 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534987289 0 0) 0x7f3f70001110 con 0x7f3f7c1531a0 2024-09-13T18:10:37.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f79d9b700 1 --2- 172.21.15.88:0/3776116228 >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:10:37.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7ad9d700 1 --2- 172.21.15.88:0/3776116228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009d90 tx=0x7f3f7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1371665b26287ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:37.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7959a700 1 -- 172.21.15.88:0/3776116228 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7400e070 con 0x7f3f7c159390 2024-09-13T18:10:37.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7959a700 1 -- 172.21.15.88:0/3776116228 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f7400bb20 con 0x7f3f7c159390 2024-09-13T18:10:37.331 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7959a700 1 -- 172.21.15.88:0/3776116228 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74012430 con 0x7f3f7c159390 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- 172.21.15.88:0/3776116228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 msgr2=0x7f3f7c163770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/3776116228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009d90 tx=0x7f3f7400b330 comp rx=0 tx=0).stop 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- 172.21.15.88:0/3776116228 shutdown_connections 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/3776116228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c163770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/3776116228 >> v2:172.21.15.94:3300/0 conn(0x7f3f7c0ca420 0x7f3f7c158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- 172.21.15.88:0/3776116228 >> 172.21.15.88:0/3776116228 conn(0x7f3f7c06eea0 msgr2=0x7f3f7c06f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- 172.21.15.88:0/3776116228 shutdown_connections 2024-09-13T18:10:37.332 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.325+0000 7f3f7b59e700 1 -- 172.21.15.88:0/3776116228 wait complete. 2024-09-13T18:10:37.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 Processor -- start 2024-09-13T18:10:37.333 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 -- start start 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7c0ca420 0x7f3f7c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c15a990 con 0x7f3f7c1531a0 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1f2ae0 con 0x7f3f7c0ca420 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7b59e700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1e43c0 con 0x7f3f7c159390 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41348/0 (socket says 172.21.15.88:41348) 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 -- 172.21.15.88:0/731259441 learned_addr learned my addr 172.21.15.88:0/731259441 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7ad9d700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.335 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f7a59c700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7c0ca420 0x7f3f7c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 -- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 msgr2=0x7f3f7c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 -- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7c0ca420 msgr2=0x7f3f7c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7c0ca420 0x7f3f7c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 -- 172.21.15.88:0/731259441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009570 con 0x7f3f7c1531a0 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f79d9b700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e9d0 tx=0x7f3f6c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:37.336 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.329+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00ee70 con 0x7f3f7c1531a0 2024-09-13T18:10:37.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f6c00c850 con 0x7f3f7c1531a0 2024-09-13T18:10:37.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f74009a70 con 0x7f3f7c1531a0 2024-09-13T18:10:37.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00cbe0 con 0x7f3f7c1531a0 2024-09-13T18:10:37.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c1e4c20 con 0x7f3f7c1531a0 2024-09-13T18:10:37.337 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c1e47a0 con 0x7f3f7c1531a0 2024-09-13T18:10:37.338 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7f3f6c00cd40 con 0x7f3f7c1531a0 2024-09-13T18:10:37.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.333+0000 7f3f6affd700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 0x7f3f5c068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:37.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.337+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f3f6c084080 con 0x7f3f7c1531a0 2024-09-13T18:10:37.339 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.337+0000 7f3f7a59c700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 0x7f3f5c068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:37.340 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.337+0000 7f3f7a59c700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 0x7f3f5c068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f70000f60 tx=0x7f3f70007e90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:37.344 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.341+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7f3f6c0b5db0 con 0x7f3f7c1531a0 2024-09-13T18:10:37.517 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:37.513+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f7c0c9980 con 0x7f3f7c1531a0 2024-09-13T18:10:38.134 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.129+0000 7f3f6affd700 1 -- 172.21.15.88:0/731259441 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3f7c1e47a0 con 0x7f3f7c1531a0 2024-09-13T18:10:38.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.133+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 msgr2=0x7f3f5c068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.133+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 0x7f3f5c068bf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f70000f60 tx=0x7f3f70007e90 comp rx=0 tx=0).stop 2024-09-13T18:10:38.139 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 msgr2=0x7f3f7c1f2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e9d0 tx=0x7f3f6c00ece0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 shutdown_connections 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7f3f5c066730 0x7f3f5c068bf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f7c159390 0x7f3f7c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f7c1531a0 0x7f3f7c1f2090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 --2- 172.21.15.88:0/731259441 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f7c0ca420 0x7f3f7c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.140 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 >> 172.21.15.88:0/731259441 conn(0x7f3f7c06eea0 msgr2=0x7f3f7c0caef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:38.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 shutdown_connections 2024-09-13T18:10:38.141 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.137+0000 7f3f7b59e700 1 -- 172.21.15.88:0/731259441 wait complete. 2024-09-13T18:10:38.143 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:10:38.157 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:10:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 Processor -- start 2024-09-13T18:10:38.280 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 -- start start 2024-09-13T18:10:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb6840e0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6840509b0 0x7fb6840e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.282 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6840dc980 con 0x7fb6840dc4d0 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6840dd500 con 0x7fb6840509b0 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69223c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840dcc60 con 0x7fb6840d6750 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb690a39700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb6840dc4d0 0x7fb684044be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:54340/0 (socket says 172.21.15.88:54340) 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb6840509b0 0x7fb6840e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb690a39700 1 -- 172.21.15.88:0/2465453523 learned_addr learned my addr 172.21.15.88:0/2465453523 (peer_addr_for_me v1:172.21.15.88:0/0) 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb69123a700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb6840e0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 -- 172.21.15.88:0/2465453523 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 msgr2=0x7fb6840e0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb6840e0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 -- 172.21.15.88:0/2465453523 >> v1:172.21.15.88:6789/0 conn(0x7fb6840dc4d0 legacy=0x7fb684044be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.283 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 -- 172.21.15.88:0/2465453523 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840dcf40 con 0x7fb6840509b0 2024-09-13T18:10:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb691a3b700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb6840e6e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb68c04f480 tx=0x7fb68c04f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb25eaed006511f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb683fff700 1 -- 172.21.15.88:0/2465453523 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c0675d0 con 0x7fb6840509b0 2024-09-13T18:10:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb683fff700 1 -- 172.21.15.88:0/2465453523 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb68c067730 con 0x7fb6840509b0 2024-09-13T18:10:38.284 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.277+0000 7fb683fff700 1 -- 172.21.15.88:0/2465453523 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c068440 con 0x7fb6840509b0 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- 172.21.15.88:0/2465453523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 msgr2=0x7fb6840e6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb6840e6e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb68c04f480 tx=0x7fb68c04f710 comp rx=0 tx=0).stop 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- 172.21.15.88:0/2465453523 shutdown_connections 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb6840e6e10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 --2- 172.21.15.88:0/2465453523 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb6840e0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.285 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- 172.21.15.88:0/2465453523 >> 172.21.15.88:0/2465453523 conn(0x7fb68404fd00 msgr2=0x7fb684050110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- 172.21.15.88:0/2465453523 shutdown_connections 2024-09-13T18:10:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- 172.21.15.88:0/2465453523 wait complete. 2024-09-13T18:10:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 Processor -- start 2024-09-13T18:10:38.286 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.281+0000 7fb69223c700 1 -- start start 2024-09-13T18:10:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.289 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb68404dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 0x7fb684176500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840491b0 con 0x7fb6840509b0 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840dd650 con 0x7fb6840dc4d0 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6840dd930 con 0x7fb6840d6750 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41372/0 (socket says 172.21.15.88:41372) 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 -- 172.21.15.88:0/754358478 learned_addr learned my addr 172.21.15.88:0/754358478 (peer_addr_for_me v2:172.21.15.88:0/0) 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb690a39700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb68404dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb691a3b700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 0x7fb684176500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 -- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 msgr2=0x7fb68404dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb68404dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 -- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 msgr2=0x7fb684176500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:38.290 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 0x7fb684176500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 -- 172.21.15.88:0/754358478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6840d6cb0 con 0x7fb6840509b0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb690a39700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb68404dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb691a3b700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 0x7fb684176500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69123a700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e760 tx=0x7fb67c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c013610 con 0x7fb6840509b0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb67c013770 con 0x7fb6840509b0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6840ddc10 con 0x7fb6840509b0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c013b00 con 0x7fb6840509b0 2024-09-13T18:10:38.291 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6840debe0 con 0x7fb6840509b0 2024-09-13T18:10:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb684035de0 con 0x7fb6840509b0 2024-09-13T18:10:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.285+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 86092+0+0 (secure 0 0 0) 0x7fb67c013c60 con 0x7fb6840509b0 2024-09-13T18:10:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.289+0000 7fb681ffb700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 0x7fb670068bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:10:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.289+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5645+0+0 (secure 0 0 0) 0x7fb67c0842b0 con 0x7fb6840509b0 2024-09-13T18:10:38.292 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.289+0000 7fb690a39700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 0x7fb670068bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:10:38.293 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.289+0000 7fb690a39700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 0x7fb670068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb68404a870 tx=0x7fb688009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:10:38.300 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.297+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175519 (secure 0 0 0) 0x7fb67c051530 con 0x7fb6840509b0 2024-09-13T18:10:38.473 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:38.469+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb684005dc0 con 0x7fb6840509b0 2024-09-13T18:10:39.149 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.145+0000 7fb681ffb700 1 -- 172.21.15.88:0/754358478 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb67c054b50 con 0x7fb6840509b0 2024-09-13T18:10:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 msgr2=0x7fb670068bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 0x7fb670068bf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb68404a870 tx=0x7fb688009040 comp rx=0 tx=0).stop 2024-09-13T18:10:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 msgr2=0x7fb684048a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:10:39.156 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00e760 tx=0x7fb67c00eb20 comp rx=0 tx=0).stop 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 shutdown_connections 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:6832/2322387369,v1:172.21.15.94:6833/2322387369] conn(0x7fb670066730 0x7fb670068bf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6840d6750 0x7fb68404dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6840dc4d0 0x7fb684176500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 --2- 172.21.15.88:0/754358478 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb6840509b0 0x7fb684048a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 >> 172.21.15.88:0/754358478 conn(0x7fb68404fd00 msgr2=0x7fb6840d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 shutdown_connections 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:2024-09-13T18:10:39.153+0000 7fb69223c700 1 -- 172.21.15.88:0/754358478 wait complete. 2024-09-13T18:10:39.157 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2024-09-13T18:10:39.171 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:10:39.171 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:10:39.171 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.181 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:10:39.181 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:10:39.181 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.193 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:10:39.194 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-09-13T18:10:39.194 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.208 INFO:tasks.ceph.mds.e:Stopped 2024-09-13T18:10:39.208 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:10:39.208 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.224 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:10:39.224 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:10:39.224 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.281 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:10:39.281 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-09-13T18:10:39.281 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:39.293 INFO:tasks.ceph.mds.f:Stopped 2024-09-13T18:10:39.293 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:10:39.293 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:10:39.293 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:40.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-13T18:10:45.395 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:10:45.396 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:10:45.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:45.475 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:10:45.475 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:10:45.476 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:45.569 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:10:45.570 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:10:45.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:46.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-13T18:10:46.712 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-13T18:10:51.672 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:10:51.672 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:10:51.672 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:51.767 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:10:51.768 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:10:51.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:52.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-13T18:10:52.574 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-13T18:10:57.869 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:10:57.869 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:10:57.870 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:57.951 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:10:57.951 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:10:57.952 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:10:58.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-13T18:10:58.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-13T18:11:03.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-13T18:11:03.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-13T18:11:04.053 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:11:04.053 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:11:04.054 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:11:04.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:11:04.083 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:11:04.083 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:11:04.083 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:11:04.117 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:11:04.117 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:11:04.117 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:11:04.117 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:11:04.173 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:11:04.173 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:11:04.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:11:04.224 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:11:04.225 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:11:04.225 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:11:04.266 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:11:04.267 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:11:04.267 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | head -n 1 2024-09-13T18:11:04.295 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:11:04.295 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:11:04.558 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:11:04.558 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:11:04.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:11:04.833 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:11:04.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:04.907 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:05.053 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:11:05.053 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:11:05.305 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:11:05.306 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:11:05.500 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:11:05.501 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:11:05.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:11:05.693 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:11:05.860 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:11:05.860 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:11:06.009 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:11:06.010 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/data/mon.a.tgz 2024-09-13T18:11:06.011 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-09-13T18:11:06.017 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.0s8XJTEaHo 2024-09-13T18:11:06.018 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0s8XJTEaHo 2024-09-13T18:11:06.106 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.0s8XJTEaHo 2024-09-13T18:11:06.131 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.0s8XJTEaHo is 346KB 2024-09-13T18:11:06.149 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.0s8XJTEaHo 2024-09-13T18:11:06.155 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/data/mon.b.tgz 2024-09-13T18:11:06.156 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-13T18:11:06.162 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.wJ2Oq2DLPW 2024-09-13T18:11:06.162 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wJ2Oq2DLPW 2024-09-13T18:11:06.266 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.wJ2Oq2DLPW 2024-09-13T18:11:06.293 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.wJ2Oq2DLPW is 414KB 2024-09-13T18:11:06.352 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.wJ2Oq2DLPW 2024-09-13T18:11:06.359 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/data/mon.c.tgz 2024-09-13T18:11:06.359 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-09-13T18:11:06.366 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.DMwzRTS7pN 2024-09-13T18:11:06.366 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.DMwzRTS7pN 2024-09-13T18:11:06.450 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.DMwzRTS7pN 2024-09-13T18:11:06.471 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.DMwzRTS7pN is 363KB 2024-09-13T18:11:06.532 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.DMwzRTS7pN 2024-09-13T18:11:06.539 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:11:06.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:11:06.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:11:06.559 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:11:06.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:11:06.562 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:11:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:11:06.625 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:11:06.631 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:11:06.633 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi088/crash 2024-09-13T18:11:06.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:11:06.651 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi094/crash 2024-09-13T18:11:06.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:11:06.667 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:11:06.667 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:06.670 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:06.729 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:06.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:11:06.758 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:11:06.758 DEBUG:teuthology.orchestra.run.smithi088:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:11:06.760 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:11:08.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-13T18:11:30.214 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:11:30.215 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi088/log 2024-09-13T18:11:30.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:11:32.882 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi094/log 2024-09-13T18:11:32.883 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:11:35.351 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:11:35.360 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:11:35.360 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:11:35.363 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:11:35.460 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:11:35.469 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:11:35.469 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:11:35.472 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:11:35.494 INFO:teuthology.orchestra.run.smithi094.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:11:35.494 INFO:teuthology.orchestra.run.smithi094.stdout:============================================================================== 2024-09-13T18:11:35.495 INFO:teuthology.orchestra.run.smithi094.stdout:*hv01.front.sepi 67.205.162.81 3 u 18 64 377 0.082 2.301 1.572 2024-09-13T18:11:35.495 INFO:teuthology.orchestra.run.smithi094.stdout:+hv02.front.sepi 96.245.170.99 3 u 8 64 377 0.088 -0.652 1.675 2024-09-13T18:11:35.495 INFO:teuthology.orchestra.run.smithi094.stdout:+hv03.front.sepi 74.6.168.72 3 u 13 64 377 0.067 3.157 1.438 2024-09-13T18:11:35.495 INFO:teuthology.orchestra.run.smithi094.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-09-13T18:11:35.496 INFO:teuthology.orchestra.run.smithi088.stdout: remote refid st t when poll reach delay offset jitter 2024-09-13T18:11:35.496 INFO:teuthology.orchestra.run.smithi088.stdout:============================================================================== 2024-09-13T18:11:35.496 INFO:teuthology.orchestra.run.smithi088.stdout:*hv01.front.sepi 67.205.162.81 3 u 20 64 377 0.078 0.300 0.525 2024-09-13T18:11:35.496 INFO:teuthology.orchestra.run.smithi088.stdout:+hv02.front.sepi 96.245.170.99 3 u 13 64 377 0.080 -2.088 0.465 2024-09-13T18:11:35.497 INFO:teuthology.orchestra.run.smithi088.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 64 377 0.070 0.571 0.616 2024-09-13T18:11:35.497 INFO:teuthology.orchestra.run.smithi088.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-09-13T18:11:35.497 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:11:35.506 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:11:35.506 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:11:35.514 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:11:35.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:11:35.531 INFO:teuthology.task.internal:Duration was 951.470433 seconds 2024-09-13T18:11:35.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:11:35.540 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:11:35.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:11:35.543 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:11:35.594 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:11:35.594 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-09-13T18:11:35.594 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:11:35.605 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-09-13T18:11:35.605 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:11:35.618 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:11:35.618 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:11:35.653 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:11:35.693 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:11:35.694 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:11:35.696 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:11:35.805 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:11:35.815 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:11:35.816 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:11:35.831 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:11:35.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:11:35.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:11:35.901 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:11:35.914 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-09-13T18:11:35.915 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-09-13T18:11:36.090 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:11:36.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:11:36.096 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:11:36.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:11:36.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:11:36.150 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:11:36.151 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi088 2024-09-13T18:11:36.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:11:36.181 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903951/remote/smithi094 2024-09-13T18:11:36.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:11:36.206 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:11:36.207 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:11:36.220 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:11:36.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:11:36.264 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:11:36.264 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:11:36.274 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:11:36.274 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:11:36.277 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:11:36.282 INFO:teuthology.orchestra.run.smithi088.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:11 /home/ubuntu/cephtest 2024-09-13T18:11:36.284 INFO:teuthology.orchestra.run.smithi094.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:11 /home/ubuntu/cephtest 2024-09-13T18:11:36.286 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:11:36.298 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:11:36.322 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_20.04} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} duration: 951.470433473587 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-09-13T18:11:36.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:11:36.417 INFO:teuthology.run:pass